[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:51 dist-test-slave-6bbx krb5kdc[5920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:51 dist-test-slave-6bbx krb5kdc[5920](info): set up 2 sockets
Aug 07 19:54:51 dist-test-slave-6bbx krb5kdc[5920](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 19:54:52.654958 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:52 dist-test-slave-6bbx krb5kdc[5920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:54:52.868667 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:35667
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:35667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:53.230018 5936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:53.230474 5936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:53.230618 5936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:53.238169 5936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:53.238307 5936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:53.238358 5936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:53.238441 5936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:53.238502 5936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:53.249459 5936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:35667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:35667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:53.251780 5936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:53.253860 5936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:53.277513 5944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:53.278127 5946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:53.278194 5950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:53.279243 5936 server_base.cc:1034] running on GCE node
I20260807 19:54:53.280544 5936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:53.283142 5936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:53.284513 5936 hybrid_clock.cc:648] HybridClock initialized: now 1786132493284418 us; error 92 us; skew 500 ppm
I20260807 19:54:53.285136 5936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:53 dist-test-slave-6bbx krb5kdc[5920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132493, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:53.288866 5936 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:54:53.291767 5936 webserver.cc:460] Webserver started at http://127.5.197.190:42311/ using document root <none> and password file <none>
I20260807 19:54:53.293064 5936 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:53.293210 5936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:53.293735 5936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:53.298736 5936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "a0c47679b31f4eb8af4f08e62b4219b1"
format_stamp: "Formatted at 2026-08-07 19:54:53 on dist-test-slave-6bbx"
server_key: "4cfd5f5b527b4d79c213785d93d0e20b"
server_key_iv: "7aaf409bf39f7cc32dae208d31a74bfd"
server_key_version: "encryptionkey@0"
I20260807 19:54:53.299929 5936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "a0c47679b31f4eb8af4f08e62b4219b1"
format_stamp: "Formatted at 2026-08-07 19:54:53 on dist-test-slave-6bbx"
server_key: "4cfd5f5b527b4d79c213785d93d0e20b"
server_key_iv: "7aaf409bf39f7cc32dae208d31a74bfd"
server_key_version: "encryptionkey@0"
I20260807 19:54:53.308566 5936 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260807 19:54:53.314929 5960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:53.317252 5936 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.001s
I20260807 19:54:53.317658 5936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "a0c47679b31f4eb8af4f08e62b4219b1"
format_stamp: "Formatted at 2026-08-07 19:54:53 on dist-test-slave-6bbx"
server_key: "4cfd5f5b527b4d79c213785d93d0e20b"
server_key_iv: "7aaf409bf39f7cc32dae208d31a74bfd"
server_key_version: "encryptionkey@0"
I20260807 19:54:53.317898 5936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:53.340822 5936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:53.346653 5936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:53.347050 5936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:53.371711 5936 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:35667
I20260807 19:54:53.371726 6031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:35667 every 8 connection(s)
I20260807 19:54:53.374341 5936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:53.378319 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5936
I20260807 19:54:53.378715 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:53.381821 5910 external_mini_cluster.cc:1428] Setting key 66d7757178516753e8395277b9fac821
I20260807 19:54:53.383426 6032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:53.405644 6032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1: Bootstrap starting.
I20260807 19:54:53.412598 6032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:53.414795 6032 log.cc:824] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:53.420151 6032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1: No bootstrap required, opened a new log
Aug 07 19:54:53 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:54:53.433202 6032 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35667 } }
I20260807 19:54:53.434007 6032 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:53.434232 6032 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c47679b31f4eb8af4f08e62b4219b1, State: Initialized, Role: FOLLOWER
I20260807 19:54:53.435757 6032 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35667 } }
I20260807 19:54:53.436081 6035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:53.389349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51182 (local address 127.5.197.190:35667)
0807 19:54:53.391575 (+ 2226us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:53.391588 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:53.391643 (+ 55us) server_negotiation.cc:407] Connection header received
0807 19:54:53.404041 (+ 12398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:53.404068 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:53.404762 (+ 694us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:53.405241 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:53.410080 (+ 4839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:53.412121 (+ 2041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:53.415050 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:53.416246 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:53.416585 (+ 339us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:53.424068 (+ 7483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:53.424163 (+ 95us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:53.424213 (+ 50us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:53.424276 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:53.428653 (+ 4377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:53.429777 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:53.429787 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:53.429805 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:53.430216 (+ 411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:53.430795 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:53.430801 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:53.430804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:53.431961 (+ 1157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:53.432443 (+ 482us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:53.433418 (+ 975us) server_negotiation.cc:299] Negotiation successful
0807 19:54:53.433918 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1899,"thread_start_us":1591,"threads_started":1}
I20260807 19:54:53.436223 6032 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:53.436527 6032 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:53.436764 6032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:53.439632 6032 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35667 } }
I20260807 19:54:53.440938 6032 leader_election.cc:302] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0c47679b31f4eb8af4f08e62b4219b1; no voters:
I20260807 19:54:53.441927 6032 leader_election.cc:288] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:53.442094 6038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:53.443392 6038 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [term 1 LEADER]: Becoming Leader. State: Replica: a0c47679b31f4eb8af4f08e62b4219b1, State: Running, Role: LEADER
I20260807 19:54:53.444237 6038 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35667 } }
I20260807 19:54:53.445276 6032 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:53.449885 6039 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35667 } } }
I20260807 19:54:53.450371 6039 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:53.450659 6040 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0c47679b31f4eb8af4f08e62b4219b1. Latest consensus state: current_term: 1 leader_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0c47679b31f4eb8af4f08e62b4219b1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35667 } } }
I20260807 19:54:53.451025 6040 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:53.457541 6047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:53.466446 6047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:53.480711 6047 catalog_manager.cc:1347] Generated new cluster ID: f8ca5051c0e44d4c9f7cb78e8a66ecc8
I20260807 19:54:53.480849 6047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:53.500578 6047 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:53.502360 6047 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:53.512902 6047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0c47679b31f4eb8af4f08e62b4219b1: Generated new TSK 0
I20260807 19:54:53.514072 6047 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:54:53.577749 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35667
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:53.933966 6064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:53.934281 6064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:53.934435 6064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:53.942001 6064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:53.942134 6064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:53.942354 6064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:54:53.952930 6064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35667
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:53.954288 6064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:53.955717 6064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:53.970192 6070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:53.970221 6076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:53.970256 6072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:53.970947 6064 server_base.cc:1034] running on GCE node
I20260807 19:54:53.971643 6064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:53.972684 6064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:53.973892 6064 hybrid_clock.cc:648] HybridClock initialized: now 1786132493973839 us; error 41 us; skew 500 ppm
I20260807 19:54:53.974220 6064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:53 dist-test-slave-6bbx krb5kdc[5920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132493, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:53.977523 6064 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:54:53.979146 6064 webserver.cc:460] Webserver started at http://127.5.197.129:41855/ using document root <none> and password file <none>
I20260807 19:54:53.979920 6064 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:53.980049 6064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:53.980381 6064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:53.983399 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "4e6c1e7d26754f60b6368b7e08c3c585"
format_stamp: "Formatted at 2026-08-07 19:54:53 on dist-test-slave-6bbx"
server_key: "634f8c5013007f7b4e30acc434594e1b"
server_key_iv: "99ef0680672b2b2b0492cc9494f661c1"
server_key_version: "encryptionkey@0"
I20260807 19:54:53.984215 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "4e6c1e7d26754f60b6368b7e08c3c585"
format_stamp: "Formatted at 2026-08-07 19:54:53 on dist-test-slave-6bbx"
server_key: "634f8c5013007f7b4e30acc434594e1b"
server_key_iv: "99ef0680672b2b2b0492cc9494f661c1"
server_key_version: "encryptionkey@0"
I20260807 19:54:53.989405 6064 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:54:53.993347 6084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:53.994710 6064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:54:53.994871 6064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "4e6c1e7d26754f60b6368b7e08c3c585"
format_stamp: "Formatted at 2026-08-07 19:54:53 on dist-test-slave-6bbx"
server_key: "634f8c5013007f7b4e30acc434594e1b"
server_key_iv: "99ef0680672b2b2b0492cc9494f661c1"
server_key_version: "encryptionkey@0"
I20260807 19:54:53.995066 6064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:54.017654 6064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:54.022049 6064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:54.022360 6064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:54.023564 6064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:54:54.025358 6064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:54:54.025439 6064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:54.025590 6064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:54:54.025645 6064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:54.058660 6064 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:42579
I20260807 19:54:54.058713 6235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:42579 every 8 connection(s)
I20260807 19:54:54.060019 6064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:54:54.070544 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6064
I20260807 19:54:54.070789 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:54:54.071498 5910 external_mini_cluster.cc:1428] Setting key 4965a67a392a5551641a86ee1e736431
Aug 07 19:54:54 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132493, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:54:54.082087 6238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:54.063362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:49451 (local address 127.5.197.190:35667)
0807 19:54:54.063882 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:54.063888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:54.064854 (+ 966us) server_negotiation.cc:407] Connection header received
0807 19:54:54.066646 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:54.066650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:54.066719 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:54.066815 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:54.068469 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.069177 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.071098 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.071512 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.071652 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:54.075978 (+ 4326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:54.075984 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:54.075987 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:54.076023 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:54.078564 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:54.079457 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:54.079461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:54.079463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:54.079604 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:54.080111 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:54.080114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:54.080117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:54.080408 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:54.080550 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:54.081459 (+ 909us) server_negotiation.cc:299] Negotiation successful
0807 19:54:54.081709 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":244,"threads_started":1}
I20260807 19:54:54.083377 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:54.063933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:35667 (local address 127.5.197.129:49451)
0807 19:54:54.064676 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:54.064722 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:54.066392 (+ 1670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:54.067092 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:54.067103 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:54.067702 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:54.068297 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:54.068320 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.069308 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.069311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:54.070952 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:54.070969 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.071814 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.071822 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:54.072116 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:54.072922 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:54.072948 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:54.075705 (+ 2757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:54.078726 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:54.078736 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:54.078754 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:54.079338 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:54.079734 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:54.079738 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:54.079740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:54.080003 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:54.080565 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:54.080574 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:54.080962 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 19:54:54.081313 (+ 351us) client_negotiation.cc:240] Negotiation successful
0807 19:54:54.081916 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":273,"threads_started":1}
I20260807 19:54:54.085148 6236 heartbeater.cc:347] Connected to a master server at 127.5.197.190:35667
I20260807 19:54:54.085608 6236 heartbeater.cc:464] Registering TS with master...
I20260807 19:54:54.086506 6236 heartbeater.cc:511] Master 127.5.197.190:35667 requested a full tablet report, sending...
I20260807 19:54:54.091368 5983 ts_manager.cc:194] Registered new tserver with Master: 4e6c1e7d26754f60b6368b7e08c3c585 (127.5.197.129:42579)
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
I20260807 19:54:54.094538 5983 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:49451
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:54:54.121187 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35667
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:54.470233 6244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:54.470547 6244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:54.470700 6244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:54.478158 6244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:54.478304 6244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:54.478468 6244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:54:54.488798 6244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35667
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:54.490288 6244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:54.491737 6244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:54.505604 6256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:54.505684 6249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:54.505640 6250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:54.506539 6244 server_base.cc:1034] running on GCE node
I20260807 19:54:54.507287 6244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:54.508387 6244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:54.509624 6244 hybrid_clock.cc:648] HybridClock initialized: now 1786132494509567 us; error 44 us; skew 500 ppm
I20260807 19:54:54.509967 6244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:54 dist-test-slave-6bbx krb5kdc[5920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132494, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:54.513397 6244 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:54:54.514961 6244 webserver.cc:460] Webserver started at http://127.5.197.130:38539/ using document root <none> and password file <none>
I20260807 19:54:54.515750 6244 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:54.515872 6244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:54.516249 6244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:54.519419 6244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "81acc8428ee64a0db485ca7a47265a8a"
format_stamp: "Formatted at 2026-08-07 19:54:54 on dist-test-slave-6bbx"
server_key: "f53c7dacedc52069c915ad3feebad60f"
server_key_iv: "3d3ac616409aa0196f1ae50d1177e1c0"
server_key_version: "encryptionkey@0"
I20260807 19:54:54.520294 6244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "81acc8428ee64a0db485ca7a47265a8a"
format_stamp: "Formatted at 2026-08-07 19:54:54 on dist-test-slave-6bbx"
server_key: "f53c7dacedc52069c915ad3feebad60f"
server_key_iv: "3d3ac616409aa0196f1ae50d1177e1c0"
server_key_version: "encryptionkey@0"
I20260807 19:54:54.526127 6244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:54:54.530118 6267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:54.531579 6244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:54:54.531800 6244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "81acc8428ee64a0db485ca7a47265a8a"
format_stamp: "Formatted at 2026-08-07 19:54:54 on dist-test-slave-6bbx"
server_key: "f53c7dacedc52069c915ad3feebad60f"
server_key_iv: "3d3ac616409aa0196f1ae50d1177e1c0"
server_key_version: "encryptionkey@0"
I20260807 19:54:54.532022 6244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:54.559346 6244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:54.563961 6244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:54.564226 6244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:54.565244 6244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:54:54.566715 6244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:54:54.566807 6244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:54.566893 6244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:54:54.566938 6244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:54.599534 6244 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:45859
I20260807 19:54:54.599630 6416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:45859 every 8 connection(s)
I20260807 19:54:54.600936 6244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:54:54.602200 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6244
I20260807 19:54:54.602419 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:54:54.602983 5910 external_mini_cluster.cc:1428] Setting key df165786c7ef0a43e33f8715c490fc25
Aug 07 19:54:54 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132494, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:54:54.621894 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:54.604200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:57481 (local address 127.5.197.190:35667)
0807 19:54:54.604674 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:54.604681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:54.605796 (+ 1115us) server_negotiation.cc:407] Connection header received
0807 19:54:54.607734 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:54.607739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:54.607820 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:54.607916 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:54.609488 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.610199 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.611799 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.612240 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.612367 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:54.616082 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:54.616087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:54.616090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:54.616124 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:54.618654 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:54.619415 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:54.619419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:54.619422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:54.619556 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:54.620036 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:54.620040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:54.620042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:54.620307 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:54.620453 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:54.621271 (+ 818us) server_negotiation.cc:299] Negotiation successful
0807 19:54:54.621521 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":228,"threads_started":1}
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
I20260807 19:54:54.623040 6422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:54.604862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:35667 (local address 127.5.197.130:57481)
0807 19:54:54.605638 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:54.605678 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:54.607437 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:54.608178 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:54.608187 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:54.608713 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:54.609307 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:54.609325 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.610363 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.610367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:54.611624 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:54.611642 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:54.612490 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:54.612497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:54.612721 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:54.613421 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:54.613443 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:54.615837 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:54.618803 (+ 2966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:54.618813 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:54.618834 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:54.619278 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:54.619698 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:54.619703 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:54.619707 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:54.619918 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:54.620446 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:54.620454 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:54.620891 (+ 437us) client_negotiation.cc:769] Sending connection context
0807 19:54:54.621141 (+ 250us) client_negotiation.cc:240] Negotiation successful
0807 19:54:54.621701 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":342,"threads_started":1}
I20260807 19:54:54.624691 6419 heartbeater.cc:347] Connected to a master server at 127.5.197.190:35667
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
I20260807 19:54:54.625046 6419 heartbeater.cc:464] Registering TS with master...
I20260807 19:54:54.626009 6419 heartbeater.cc:511] Master 127.5.197.190:35667 requested a full tablet report, sending...
I20260807 19:54:54.627750 5983 ts_manager.cc:194] Registered new tserver with Master: 81acc8428ee64a0db485ca7a47265a8a (127.5.197.130:45859)
I20260807 19:54:54.628592 5983 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:57481
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:54:54.649392 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35667
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:54.984543 6426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:54.984853 6426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:54.984952 6426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:54.992525 6426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:54.992658 6426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:54.992776 6426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:54:55.002941 6426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35667
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:55.004323 6426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:55.005628 6426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:55.018632 6433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:55.018568 6434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:55.018682 6436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:55.019582 6426 server_base.cc:1034] running on GCE node
I20260807 19:54:55.020249 6426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:55.021242 6426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:55.022460 6426 hybrid_clock.cc:648] HybridClock initialized: now 1786132495022403 us; error 50 us; skew 500 ppm
I20260807 19:54:55.022791 6426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:55.026139 6426 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:54:55.027699 6426 webserver.cc:460] Webserver started at http://127.5.197.131:33177/ using document root <none> and password file <none>
I20260807 19:54:55.028460 6426 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:55.028589 6426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:55.028920 6426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:55.032001 6426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "8904e77513254d1684242911ae4a6e93"
format_stamp: "Formatted at 2026-08-07 19:54:55 on dist-test-slave-6bbx"
server_key: "f044ff4bc951e29852a1576424d30f82"
server_key_iv: "310c18c2c36e1e079657f0932ced7855"
server_key_version: "encryptionkey@0"
I20260807 19:54:55.032780 6426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "8904e77513254d1684242911ae4a6e93"
format_stamp: "Formatted at 2026-08-07 19:54:55 on dist-test-slave-6bbx"
server_key: "f044ff4bc951e29852a1576424d30f82"
server_key_iv: "310c18c2c36e1e079657f0932ced7855"
server_key_version: "encryptionkey@0"
I20260807 19:54:55.038398 6426 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:54:55.042203 6444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:55.043563 6426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:54:55.043746 6426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "8904e77513254d1684242911ae4a6e93"
format_stamp: "Formatted at 2026-08-07 19:54:55 on dist-test-slave-6bbx"
server_key: "f044ff4bc951e29852a1576424d30f82"
server_key_iv: "310c18c2c36e1e079657f0932ced7855"
server_key_version: "encryptionkey@0"
I20260807 19:54:55.043952 6426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:55.064677 6426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:55.068929 6426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:55.069234 6426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:55.070405 6426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:54:55.072011 6426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:54:55.072100 6426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:55.072244 6426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:54:55.072307 6426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:55.099289 6236 heartbeater.cc:503] Master 127.5.197.190:35667 was elected leader, sending a full tablet report...
I20260807 19:54:55.107846 6426 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:43915
I20260807 19:54:55.107896 6590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:43915 every 8 connection(s)
I20260807 19:54:55.109150 6426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:54:55.109679 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6426
I20260807 19:54:55.109876 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:54:55.110443 5910 external_mini_cluster.cc:1428] Setting key da6ed561e37bc8b2788b7d4e0ef925a8
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:54:55.129495 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:55.111979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:44585 (local address 127.5.197.190:35667)
0807 19:54:55.112156 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:55.112162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:55.113716 (+ 1554us) server_negotiation.cc:407] Connection header received
0807 19:54:55.115716 (+ 2000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:55.115722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:55.115804 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:55.115884 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:55.117389 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.118101 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.119573 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.120032 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.120125 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:55.123782 (+ 3657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:55.123789 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:55.123794 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:55.123833 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:55.126580 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.127493 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.127499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.127503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.127648 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.128058 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.128061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.128063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.128321 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:55.128443 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:55.129072 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 19:54:55.129245 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 19:54:55.130514 6595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:55.112696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:35667 (local address 127.5.197.131:44585)
0807 19:54:55.113528 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:55.113582 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:55.115391 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:55.116112 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:55.116120 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:55.116637 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:55.117209 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:55.117228 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.118221 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.118225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:55.119458 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:55.119470 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.120244 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.120250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:55.120454 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:55.121218 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:55.121247 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:55.123533 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:55.126730 (+ 3197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:55.126737 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:55.126750 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:55.127362 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:55.127776 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:55.127780 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:55.127782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:55.127971 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:55.128424 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:55.128430 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:55.128763 (+ 333us) client_negotiation.cc:769] Sending connection context
0807 19:54:55.129001 (+ 238us) client_negotiation.cc:240] Negotiation successful
0807 19:54:55.129403 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":331,"threads_started":1}
I20260807 19:54:55.131830 6592 heartbeater.cc:347] Connected to a master server at 127.5.197.190:35667
I20260807 19:54:55.132140 6592 heartbeater.cc:464] Registering TS with master...
I20260807 19:54:55.132867 6592 heartbeater.cc:511] Master 127.5.197.190:35667 requested a full tablet report, sending...
I20260807 19:54:55.134366 5983 ts_manager.cc:194] Registered new tserver with Master: 8904e77513254d1684242911ae4a6e93 (127.5.197.131:43915)
I20260807 19:54:55.135179 5983 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:44585
I20260807 19:54:55.139776 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:54:55.189079 6603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:55.174264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35260 (local address 127.5.197.129:42579)
0807 19:54:55.175091 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:55.175099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:55.175129 (+ 30us) server_negotiation.cc:407] Connection header received
0807 19:54:55.175194 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:55.175201 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:55.175420 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:55.175553 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:55.177004 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.178053 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.179275 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.179938 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.180045 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:55.183877 (+ 3832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:55.183889 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:55.183905 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:55.183941 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:55.186708 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.187294 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.187301 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.187303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.187426 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.187773 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.187776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.187778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.188131 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:55.188369 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:55.188581 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 19:54:55.188785 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":520,"threads_started":1}
W20260807 19:54:55.190459 6120 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35260
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:54:55.239619 6603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:55.225942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35266 (local address 127.5.197.129:42579)
0807 19:54:55.226182 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:55.226189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:55.226336 (+ 147us) server_negotiation.cc:407] Connection header received
0807 19:54:55.226533 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:55.226537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:55.226635 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:55.226726 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:55.228142 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.228835 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.230077 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.230487 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.230600 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:55.234505 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:55.234510 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:55.234514 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:55.234549 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:55.237440 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.238077 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.238080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.238082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.238206 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.238543 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.238546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.238548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.238799 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:55.238985 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:55.239204 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 19:54:55.239379 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 19:54:55.241529 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6064
I20260807 19:54:55.254396 6603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:55.242616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35276 (local address 127.5.197.129:42579)
0807 19:54:55.242785 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:55.242791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:55.243111 (+ 320us) server_negotiation.cc:407] Connection header received
0807 19:54:55.243255 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:55.243259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:55.243315 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:55.243401 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:55.244626 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.245340 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.246662 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.247099 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.247206 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:55.249500 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:55.249505 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:55.249509 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:55.249539 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:55.251897 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.252496 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.252502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.252506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.252660 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.253022 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.253027 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.253031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.253293 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:55.253513 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:55.253822 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 19:54:55.254043 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 19:54:55.255225 6229 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:55.343890 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6064
I20260807 19:54:55.370447 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6244
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:54:55.388310 6616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:55.371474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37164 (local address 127.5.197.130:45859)
0807 19:54:55.372199 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:55.372209 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:55.372240 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:54:55.372325 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:55.372334 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:55.372598 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:55.372757 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:55.373910 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.375496 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.376832 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.377746 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.377888 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:55.382248 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:55.382266 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:55.382284 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:55.382330 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:55.385372 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.386177 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.386186 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.386188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.386332 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.386769 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.386772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.386774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.387151 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:55.387428 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:55.387696 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 19:54:55.387939 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":366,"threads_started":1}
I20260807 19:54:55.389717 6409 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:55.473469 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6244
I20260807 19:54:55.496196 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6426
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[5920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:54:55.512813 6619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:55.497145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50474 (local address 127.5.197.131:43915)
0807 19:54:55.497811 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:55.497819 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:55.497848 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:54:55.497921 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:55.497928 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:55.498161 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:55.498296 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:55.499528 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.500621 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.501973 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:55.502596 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:55.502695 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:55.506964 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:55.506976 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:55.506992 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:55.507029 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:55.509856 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.510525 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.510532 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.510535 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.510656 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:55.510984 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:55.510987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:55.510989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:55.511337 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:55.511582 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:55.512205 (+ 623us) server_negotiation.cc:299] Negotiation successful
0807 19:54:55.512440 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":323,"threads_started":1}
I20260807 19:54:55.514233 6586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:55.597285 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6426
I20260807 19:54:55.618304 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5936
I20260807 19:54:55.619490 6021 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:55.723317 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5936
2026-08-07T19:54:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4284 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[6626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[6626](info): set up 2 sockets
Aug 07 19:54:55 dist-test-slave-6bbx krb5kdc[6626](info): commencing operation
krb5kdc: starting...
W20260807 19:54:56.891475 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:57 dist-test-slave-6bbx krb5kdc[6626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:54:57.095594 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40079
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:40079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:57.436685 6642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:57.437196 6642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:57.437382 6642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:57.446673 6642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:57.446810 6642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:57.446941 6642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:57.447028 6642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:57.447094 6642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:57.458843 6642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:40079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:57.460321 6642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:57.461656 6642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:57.473397 6648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:57.473466 6649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:57.473444 6652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:57.474484 6642 server_base.cc:1034] running on GCE node
I20260807 19:54:57.475312 6642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:57.476902 6642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:57.478113 6642 hybrid_clock.cc:648] HybridClock initialized: now 1786132497478058 us; error 46 us; skew 500 ppm
I20260807 19:54:57.478487 6642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:57 dist-test-slave-6bbx krb5kdc[6626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132497, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:57.481637 6642 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:54:57.483196 6642 webserver.cc:460] Webserver started at http://127.5.197.190:41137/ using document root <none> and password file <none>
I20260807 19:54:57.483986 6642 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:57.484112 6642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:57.484443 6642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:57.487509 6642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "65f7634a76a642b7a881f8eb33c17c50"
format_stamp: "Formatted at 2026-08-07 19:54:57 on dist-test-slave-6bbx"
server_key: "210d21e2fae71b64c3b9814876094da2"
server_key_iv: "37c1847ceea04c4ecc72ef2401f53d9c"
server_key_version: "encryptionkey@0"
I20260807 19:54:57.488339 6642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "65f7634a76a642b7a881f8eb33c17c50"
format_stamp: "Formatted at 2026-08-07 19:54:57 on dist-test-slave-6bbx"
server_key: "210d21e2fae71b64c3b9814876094da2"
server_key_iv: "37c1847ceea04c4ecc72ef2401f53d9c"
server_key_version: "encryptionkey@0"
I20260807 19:54:57.493662 6642 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 19:54:57.497334 6661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:57.498695 6642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:54:57.498874 6642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "65f7634a76a642b7a881f8eb33c17c50"
format_stamp: "Formatted at 2026-08-07 19:54:57 on dist-test-slave-6bbx"
server_key: "210d21e2fae71b64c3b9814876094da2"
server_key_iv: "37c1847ceea04c4ecc72ef2401f53d9c"
server_key_version: "encryptionkey@0"
I20260807 19:54:57.499069 6642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:57.515756 6642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:57.520329 6642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:57.520617 6642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:57.538789 6642 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:40079
I20260807 19:54:57.538844 6726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:40079 every 8 connection(s)
I20260807 19:54:57.540313 6642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:57.544493 6729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:57.549388 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6642
I20260807 19:54:57.549597 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:57.550246 5910 external_mini_cluster.cc:1428] Setting key 0b270bc8d0cd314ee993ab625c236788
I20260807 19:54:57.555588 6729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50: Bootstrap starting.
I20260807 19:54:57.559753 6729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:57.561179 6729 log.cc:824] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:57.564498 6729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50: No bootstrap required, opened a new log
Aug 07 19:54:57 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:54:57.573427 6729 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f7634a76a642b7a881f8eb33c17c50" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40079 } }
I20260807 19:54:57.573849 6729 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:57.573951 6729 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f7634a76a642b7a881f8eb33c17c50, State: Initialized, Role: FOLLOWER
I20260807 19:54:57.574499 6735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:57.552251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.5.197.190:40079)
0807 19:54:57.553134 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:57.553146 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:57.553193 (+ 47us) server_negotiation.cc:407] Connection header received
0807 19:54:57.554932 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:57.554956 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:57.555371 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:57.555751 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:57.557837 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:57.559184 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:57.561113 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:57.562021 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:57.562260 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:57.566529 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:57.566537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:57.566556 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:57.566601 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:57.569910 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:57.570706 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:57.570717 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:57.570725 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:57.570930 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:57.571339 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:57.571343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:57.571349 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:57.572062 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:57.572399 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:57.572929 (+ 530us) server_negotiation.cc:299] Negotiation successful
0807 19:54:57.573376 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":400,"threads_started":1}
I20260807 19:54:57.574602 6729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f7634a76a642b7a881f8eb33c17c50" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40079 } }
I20260807 19:54:57.574895 6729 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:57.575045 6729 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:57.575224 6729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:57.578539 6729 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f7634a76a642b7a881f8eb33c17c50" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40079 } }
I20260807 19:54:57.579073 6729 leader_election.cc:302] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65f7634a76a642b7a881f8eb33c17c50; no voters:
I20260807 19:54:57.579758 6729 leader_election.cc:288] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:57.579891 6739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:57.581342 6739 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [term 1 LEADER]: Becoming Leader. State: Replica: 65f7634a76a642b7a881f8eb33c17c50, State: Running, Role: LEADER
I20260807 19:54:57.581875 6739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f7634a76a642b7a881f8eb33c17c50" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40079 } }
I20260807 19:54:57.582087 6729 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:57.585083 6740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65f7634a76a642b7a881f8eb33c17c50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f7634a76a642b7a881f8eb33c17c50" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40079 } } }
I20260807 19:54:57.585465 6740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:57.585911 6743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65f7634a76a642b7a881f8eb33c17c50. Latest consensus state: current_term: 1 leader_uuid: "65f7634a76a642b7a881f8eb33c17c50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f7634a76a642b7a881f8eb33c17c50" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40079 } } }
I20260807 19:54:57.586215 6743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:57.588440 6754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:57.593973 6754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:57.603843 6754 catalog_manager.cc:1347] Generated new cluster ID: 81b7738cc427449e8fa97aa4fbfb9687
I20260807 19:54:57.603976 6754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:57.616214 6754 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:57.617605 6754 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:57.625452 6754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65f7634a76a642b7a881f8eb33c17c50: Generated new TSK 0
I20260807 19:54:57.626332 6754 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:54:57.687717 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:40079
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:58.045571 6770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:58.045851 6770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:58.045950 6770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:58.053087 6770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:58.053205 6770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:58.053330 6770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:54:58.062917 6770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:40079
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:58.064168 6770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:58.065557 6770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:58.078591 6778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:58.078560 6781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:58.078626 6779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:58.079475 6770 server_base.cc:1034] running on GCE node
I20260807 19:54:58.080142 6770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:58.081079 6770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:58.082283 6770 hybrid_clock.cc:648] HybridClock initialized: now 1786132498082225 us; error 47 us; skew 500 ppm
I20260807 19:54:58.082623 6770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:58 dist-test-slave-6bbx krb5kdc[6626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132498, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:58.085793 6770 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:54:58.087275 6770 webserver.cc:460] Webserver started at http://127.5.197.129:36309/ using document root <none> and password file <none>
I20260807 19:54:58.088035 6770 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:58.088176 6770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:58.088505 6770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:58.091594 6770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "ab663ff7517f43fcadb2e18e0e513b35"
format_stamp: "Formatted at 2026-08-07 19:54:58 on dist-test-slave-6bbx"
server_key: "54e6995f110f2e692a38818e5ae70433"
server_key_iv: "af19226b5db9072ca09c1df155616881"
server_key_version: "encryptionkey@0"
I20260807 19:54:58.092515 6770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "ab663ff7517f43fcadb2e18e0e513b35"
format_stamp: "Formatted at 2026-08-07 19:54:58 on dist-test-slave-6bbx"
server_key: "54e6995f110f2e692a38818e5ae70433"
server_key_iv: "af19226b5db9072ca09c1df155616881"
server_key_version: "encryptionkey@0"
I20260807 19:54:58.097965 6770 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 19:54:58.102022 6790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:58.103480 6770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:54:58.103645 6770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "ab663ff7517f43fcadb2e18e0e513b35"
format_stamp: "Formatted at 2026-08-07 19:54:58 on dist-test-slave-6bbx"
server_key: "54e6995f110f2e692a38818e5ae70433"
server_key_iv: "af19226b5db9072ca09c1df155616881"
server_key_version: "encryptionkey@0"
I20260807 19:54:58.103912 6770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:58.149542 6770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:58.153606 6770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:58.153898 6770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:58.154924 6770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:54:58.156385 6770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:54:58.156467 6770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:58.156592 6770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:54:58.156647 6770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:58.189165 6770 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:33963
I20260807 19:54:58.189229 6938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:33963 every 8 connection(s)
I20260807 19:54:58.190572 6770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:54:58.192512 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6770
I20260807 19:54:58.192744 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:54:58.193531 5910 external_mini_cluster.cc:1428] Setting key 7eccb3753b2504430012aba470cd2e19
Aug 07 19:54:58 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132498, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
I20260807 19:54:58.217672 6943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:58.193487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:37895 (local address 127.5.197.190:40079)
0807 19:54:58.200114 (+ 6627us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:58.200119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:58.200137 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:54:58.200192 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:58.200195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:58.200262 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:58.200354 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:58.202676 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.203873 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.205630 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.206241 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.206384 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:58.210677 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:58.210685 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:58.210691 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:58.210742 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:58.214264 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:58.215138 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:58.215144 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:58.215148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:58.215318 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:58.215830 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:58.215833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:58.215836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:58.216160 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:58.216273 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:58.217112 (+ 839us) server_negotiation.cc:299] Negotiation successful
0807 19:54:58.217343 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6509,"thread_start_us":6384,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
I20260807 19:54:58.218895 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:58.193987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:40079 (local address 127.5.197.129:37895)
0807 19:54:58.194924 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:58.194981 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:58.197703 (+ 2722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:58.200763 (+ 3060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:58.200777 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:58.201558 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:58.202447 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:58.202477 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.204073 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.204077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:58.205443 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:58.205458 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.206468 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.206473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:58.206698 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:58.207595 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:58.207621 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:58.210357 (+ 2736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:58.214467 (+ 4110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:58.214475 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:58.214492 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:58.214984 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:58.215458 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:58.215461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:58.215464 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:58.215721 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:58.216331 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:58.216338 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:58.216733 (+ 395us) client_negotiation.cc:769] Sending connection context
0807 19:54:58.216987 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 19:54:58.217492 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":376,"threads_started":1}
I20260807 19:54:58.220667 6939 heartbeater.cc:347] Connected to a master server at 127.5.197.190:40079
I20260807 19:54:58.221040 6939 heartbeater.cc:464] Registering TS with master...
I20260807 19:54:58.222018 6939 heartbeater.cc:511] Master 127.5.197.190:40079 requested a full tablet report, sending...
I20260807 19:54:58.224560 6684 ts_manager.cc:194] Registered new tserver with Master: ab663ff7517f43fcadb2e18e0e513b35 (127.5.197.129:33963)
I20260807 19:54:58.226275 6684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:37895
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:54:58.246918 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:40079
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:58.583860 6947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:58.584128 6947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:58.584285 6947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:58.591461 6947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:58.591569 6947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:58.591754 6947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:54:58.601503 6947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:40079
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:58.602830 6947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:58.604270 6947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:58.617442 6952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:58.617363 6953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:58.617385 6958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:58.618435 6947 server_base.cc:1034] running on GCE node
I20260807 19:54:58.619032 6947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:58.619926 6947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:58.621138 6947 hybrid_clock.cc:648] HybridClock initialized: now 1786132498621094 us; error 32 us; skew 500 ppm
I20260807 19:54:58.621430 6947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:58 dist-test-slave-6bbx krb5kdc[6626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132498, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:58.624580 6947 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:54:58.625996 6947 webserver.cc:460] Webserver started at http://127.5.197.130:34951/ using document root <none> and password file <none>
I20260807 19:54:58.626642 6947 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:58.626749 6947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:58.627058 6947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:58.629953 6947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "c4f1b16b3b58415cb92b0d79d93be1b2"
format_stamp: "Formatted at 2026-08-07 19:54:58 on dist-test-slave-6bbx"
server_key: "4e05e77d8cb6eb2f61d4023345f39883"
server_key_iv: "1976f731060cc4fde7437a6108207041"
server_key_version: "encryptionkey@0"
I20260807 19:54:58.630690 6947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "c4f1b16b3b58415cb92b0d79d93be1b2"
format_stamp: "Formatted at 2026-08-07 19:54:58 on dist-test-slave-6bbx"
server_key: "4e05e77d8cb6eb2f61d4023345f39883"
server_key_iv: "1976f731060cc4fde7437a6108207041"
server_key_version: "encryptionkey@0"
I20260807 19:54:58.635515 6947 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260807 19:54:58.638857 6967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:58.640170 6947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:58.640323 6947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "c4f1b16b3b58415cb92b0d79d93be1b2"
format_stamp: "Formatted at 2026-08-07 19:54:58 on dist-test-slave-6bbx"
server_key: "4e05e77d8cb6eb2f61d4023345f39883"
server_key_iv: "1976f731060cc4fde7437a6108207041"
server_key_version: "encryptionkey@0"
I20260807 19:54:58.640537 6947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:58.656842 6947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:58.660665 6947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:58.660894 6947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:58.661752 6947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:54:58.663017 6947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:54:58.663087 6947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:58.663192 6947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:54:58.663235 6947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:58.694307 6947 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:37947
I20260807 19:54:58.694362 7133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:37947 every 8 connection(s)
I20260807 19:54:58.695523 6947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:54:58.697976 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6947
I20260807 19:54:58.698160 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:54:58.698673 5910 external_mini_cluster.cc:1428] Setting key 642fcd57a69cc1054bfe28196fd9b2a9
Aug 07 19:54:58 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132498, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:54:58.715493 6943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:58.698051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:47479 (local address 127.5.197.190:40079)
0807 19:54:58.698283 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:58.698289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:58.699515 (+ 1226us) server_negotiation.cc:407] Connection header received
0807 19:54:58.701365 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:58.701371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:58.701445 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:58.701541 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:58.703177 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.704194 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.705900 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.706445 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.706560 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:58.710066 (+ 3506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:58.710071 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:58.710074 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:58.710107 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:58.712539 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:58.713234 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:58.713239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:58.713241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:58.713381 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:58.713839 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:58.713842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:58.713844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:58.714116 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:58.714247 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:58.714922 (+ 675us) server_negotiation.cc:299] Negotiation successful
0807 19:54:58.715149 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 19:54:58.716434 7138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:58.698553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:40079 (local address 127.5.197.130:47479)
0807 19:54:58.699359 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:58.699405 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:58.701108 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:58.701764 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:58.701772 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:58.702392 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:58.703010 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:58.703027 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.704384 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.704389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:58.705747 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:58.705760 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:58.706674 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:58.706680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:58.706867 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:58.707518 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:58.707555 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:58.709831 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:58.712679 (+ 2848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:58.712688 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:58.712703 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:58.713110 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:58.713535 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:58.713541 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:58.713544 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:58.713723 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:58.714248 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:58.714256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:58.714570 (+ 314us) client_negotiation.cc:769] Sending connection context
0807 19:54:58.714808 (+ 238us) client_negotiation.cc:240] Negotiation successful
0807 19:54:58.715306 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":337,"threads_started":1}
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
I20260807 19:54:58.717911 7135 heartbeater.cc:347] Connected to a master server at 127.5.197.190:40079
I20260807 19:54:58.718240 7135 heartbeater.cc:464] Registering TS with master...
I20260807 19:54:58.718962 7135 heartbeater.cc:511] Master 127.5.197.190:40079 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
I20260807 19:54:58.720496 6684 ts_manager.cc:194] Registered new tserver with Master: c4f1b16b3b58415cb92b0d79d93be1b2 (127.5.197.130:37947)
I20260807 19:54:58.721310 6684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:47479
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:54:58.742846 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:40079
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:59.086634 7141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:59.086956 7141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:59.087116 7141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:59.094821 7141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:59.094954 7141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:59.095116 7141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:54:59.105541 7141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:40079
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:59.106911 7141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:59.108479 7141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:59.122264 7150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:59.122289 7147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:59.122315 7152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:59.123293 7141 server_base.cc:1034] running on GCE node
I20260807 19:54:59.124028 7141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:59.125037 7141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:59.126250 7141 hybrid_clock.cc:648] HybridClock initialized: now 1786132499126204 us; error 37 us; skew 500 ppm
I20260807 19:54:59.126571 7141 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:59 dist-test-slave-6bbx krb5kdc[6626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:59.129971 7141 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:54:59.131552 7141 webserver.cc:460] Webserver started at http://127.5.197.131:42673/ using document root <none> and password file <none>
I20260807 19:54:59.132302 7141 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:59.132429 7141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:59.132745 7141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:59.135818 7141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "0d717cf2a2a24f42af094f5c9a33d5f0"
format_stamp: "Formatted at 2026-08-07 19:54:59 on dist-test-slave-6bbx"
server_key: "df5091df0d529fb5e8d8db73268f5e0d"
server_key_iv: "c2754acd9a31ab258dc72cc580640b7d"
server_key_version: "encryptionkey@0"
I20260807 19:54:59.136656 7141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "0d717cf2a2a24f42af094f5c9a33d5f0"
format_stamp: "Formatted at 2026-08-07 19:54:59 on dist-test-slave-6bbx"
server_key: "df5091df0d529fb5e8d8db73268f5e0d"
server_key_iv: "c2754acd9a31ab258dc72cc580640b7d"
server_key_version: "encryptionkey@0"
I20260807 19:54:59.142251 7141 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:54:59.146075 7159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:59.147480 7141 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:54:59.147658 7141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "0d717cf2a2a24f42af094f5c9a33d5f0"
format_stamp: "Formatted at 2026-08-07 19:54:59 on dist-test-slave-6bbx"
server_key: "df5091df0d529fb5e8d8db73268f5e0d"
server_key_iv: "c2754acd9a31ab258dc72cc580640b7d"
server_key_version: "encryptionkey@0"
I20260807 19:54:59.147949 7141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:59.176201 7141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:59.180763 7141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:59.181062 7141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:59.182103 7141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:54:59.183691 7141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:54:59.183771 7141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 19:54:59.183900 7141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:54:59.183955 7141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:59.215633 7141 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39157
I20260807 19:54:59.215708 7316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39157 every 8 connection(s)
I20260807 19:54:59.217180 7141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:54:59.223328 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 7141
I20260807 19:54:59.223523 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:54:59.223990 5910 external_mini_cluster.cc:1428] Setting key f57abbf52778b59fc2f2f1590ca57427
I20260807 19:54:59.229804 6939 heartbeater.cc:503] Master 127.5.197.190:40079 was elected leader, sending a full tablet report...
Aug 07 19:54:59 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:54:59.238459 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.219843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:57879 (local address 127.5.197.190:40079)
0807 19:54:59.220326 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.220331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.221375 (+ 1044us) server_negotiation.cc:407] Connection header received
0807 19:54:59.223341 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.223347 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.223439 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.223552 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:59.225309 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.226385 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.228318 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.228720 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.228825 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.232533 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:59.232538 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:59.232541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:59.232575 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:59.235079 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.235942 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.235946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.235949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.236086 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.236557 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.236561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.236563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.236844 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:59.236991 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.237806 (+ 815us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.238063 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":224,"threads_started":1}
I20260807 19:54:59.239723 7320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.220429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:40079 (local address 127.5.197.131:57879)
0807 19:54:59.221183 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.221234 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.223032 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.223855 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.223865 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.224417 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:59.225139 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.225157 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.226558 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.226564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.228170 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.228188 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.228934 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.228939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.229148 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.229932 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:59.229960 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:59.232295 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:59.235243 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:59.235253 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:59.235270 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:59.235803 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:59.236203 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:59.236209 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:59.236213 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:59.236429 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:59.236991 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:59.236999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:59.237365 (+ 366us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.237649 (+ 284us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.238228 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":313,"threads_started":1}
I20260807 19:54:59.241148 7317 heartbeater.cc:347] Connected to a master server at 127.5.197.190:40079
I20260807 19:54:59.241515 7317 heartbeater.cc:464] Registering TS with master...
I20260807 19:54:59.242323 7317 heartbeater.cc:511] Master 127.5.197.190:40079 requested a full tablet report, sending...
I20260807 19:54:59.243880 6684 ts_manager.cc:194] Registered new tserver with Master: 0d717cf2a2a24f42af094f5c9a33d5f0 (127.5.197.131:39157)
I20260807 19:54:59.244695 6684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:57879
I20260807 19:54:59.252959 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:54:59.273586 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.260518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35730 (local address 127.5.197.190:40079)
0807 19:54:59.260774 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.260780 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.261057 (+ 277us) server_negotiation.cc:407] Connection header received
0807 19:54:59.261212 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.261216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.261283 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.261393 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:59.262919 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.263645 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.264984 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.265425 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.265520 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.268039 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:59.268044 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:59.268047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:59.268085 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:59.270677 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.271471 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.271478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.271482 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.271625 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.272041 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.272046 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.272049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.272415 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:59.272673 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.273034 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.273270 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 19:54:59.282994 6684 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35730:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:54:59.291932 6684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:54:59.326187 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.309907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52660 (local address 127.5.197.130:37947)
0807 19:54:59.315998 (+ 6091us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.316009 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.316044 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:54:59.316168 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.316177 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.316462 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.317484 (+ 1022us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:54:59.317748 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.320204 (+ 2456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.323080 (+ 2876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.324607 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.324771 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.324997 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.325672 (+ 675us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.325850 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5934,"thread_start_us":5817,"threads_started":1}
I20260807 19:54:59.326237 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.309688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:37947 (local address 127.0.0.1:52660)
0807 19:54:59.312312 (+ 2624us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.312332 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.312452 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.316757 (+ 4305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.316767 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.316803 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:54:59.317246 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.317259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.320352 (+ 3093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.320358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.322893 (+ 2535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.322914 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.325128 (+ 2214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.325134 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.325368 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.325434 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.325590 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.325794 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2489,"mutex_wait_us":81,"thread_start_us":11116,"threads_started":1}
I20260807 19:54:59.327777 7336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.309144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39157 (local address 127.0.0.1:52640)
0807 19:54:59.310014 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.310092 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.310366 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.321416 (+ 11050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.321421 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.321446 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:54:59.321806 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.321816 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.323514 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.323519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.325302 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.325315 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.326993 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.327000 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.327166 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.327192 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.327278 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.327401 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":967,"threads_started":1}
I20260807 19:54:59.327859 7337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.309418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52640 (local address 127.5.197.131:39157)
0807 19:54:59.320823 (+ 11405us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.320830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.320864 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:54:59.320958 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.320965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.321229 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.321435 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:54:59.321995 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.323383 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.325465 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.326779 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.326892 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.327115 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.327344 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.327507 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11215,"thread_start_us":11060,"threads_started":1}
I20260807 19:54:59.329873 7338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.310910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:33963 (local address 127.0.0.1:59268)
0807 19:54:59.321160 (+ 10250us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.321176 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.321308 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.322445 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.322449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.322475 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:54:59.322876 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.322885 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.324814 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.324819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.326904 (+ 2085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.326924 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.329193 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.329198 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.329323 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.329347 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.329429 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.329513 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10135,"mutex_wait_us":3,"thread_start_us":3228,"threads_started":1}
I20260807 19:54:59.329982 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.311524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59268 (local address 127.5.197.129:33963)
0807 19:54:59.319692 (+ 8168us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.319702 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.321304 (+ 1602us) server_negotiation.cc:407] Connection header received
0807 19:54:59.322023 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.322030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.322239 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.322411 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:54:59.323048 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.324653 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.327101 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.328951 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.329108 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.329357 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.329475 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.329649 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7935,"thread_start_us":7737,"threads_started":1}
I20260807 19:54:59.331871 7040 tablet_service.cc:1467] Processing CreateTablet for tablet d7b49467387f4d4eae8fbdb1dd524184 (DEFAULT_TABLE table=test-table [id=524310f845f244ba96f98b94db376821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:54:59.333727 7040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7b49467387f4d4eae8fbdb1dd524184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:59.334074 6852 tablet_service.cc:1467] Processing CreateTablet for tablet d7b49467387f4d4eae8fbdb1dd524184 (DEFAULT_TABLE table=test-table [id=524310f845f244ba96f98b94db376821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:54:59.334518 7230 tablet_service.cc:1467] Processing CreateTablet for tablet d7b49467387f4d4eae8fbdb1dd524184 (DEFAULT_TABLE table=test-table [id=524310f845f244ba96f98b94db376821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:54:59.335597 6852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7b49467387f4d4eae8fbdb1dd524184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:59.335783 7230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7b49467387f4d4eae8fbdb1dd524184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:59.348970 7343 tablet_bootstrap.cc:492] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0: Bootstrap starting.
I20260807 19:54:59.351120 7345 tablet_bootstrap.cc:492] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35: Bootstrap starting.
I20260807 19:54:59.353444 7343 tablet_bootstrap.cc:654] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:59.354854 7343 log.cc:824] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:59.354954 7345 tablet_bootstrap.cc:654] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:59.355943 7344 tablet_bootstrap.cc:492] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2: Bootstrap starting.
I20260807 19:54:59.356280 7345 log.cc:824] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:59.358456 7343 tablet_bootstrap.cc:492] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0: No bootstrap required, opened a new log
I20260807 19:54:59.358762 7343 ts_tablet_manager.cc:1397] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 19:54:59.359977 7345 tablet_bootstrap.cc:492] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35: No bootstrap required, opened a new log
I20260807 19:54:59.360299 7345 ts_tablet_manager.cc:1397] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260807 19:54:59.360456 7344 tablet_bootstrap.cc:654] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:59.361469 7344 log.cc:824] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:59.364233 7344 tablet_bootstrap.cc:492] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2: No bootstrap required, opened a new log
I20260807 19:54:59.364513 7344 ts_tablet_manager.cc:1397] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 19:54:59.369547 7343 raft_consensus.cc:348] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.370046 7343 raft_consensus.cc:374] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:59.370204 7343 raft_consensus.cc:729] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d717cf2a2a24f42af094f5c9a33d5f0, State: Initialized, Role: FOLLOWER
I20260807 19:54:59.370926 7343 consensus_queue.cc:260] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.370846 7345 raft_consensus.cc:348] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.371362 7345 raft_consensus.cc:374] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:59.371492 7345 raft_consensus.cc:729] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab663ff7517f43fcadb2e18e0e513b35, State: Initialized, Role: FOLLOWER
I20260807 19:54:59.371881 7344 raft_consensus.cc:348] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.372411 7344 raft_consensus.cc:374] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:59.372314 7345 consensus_queue.cc:260] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.372563 7344 raft_consensus.cc:729] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4f1b16b3b58415cb92b0d79d93be1b2, State: Initialized, Role: FOLLOWER
I20260807 19:54:59.373142 7317 heartbeater.cc:503] Master 127.5.197.190:40079 was elected leader, sending a full tablet report...
I20260807 19:54:59.373202 7344 consensus_queue.cc:260] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.373919 7343 ts_tablet_manager.cc:1428] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260807 19:54:59.375612 7135 heartbeater.cc:503] Master 127.5.197.190:40079 was elected leader, sending a full tablet report...
I20260807 19:54:59.377588 7344 ts_tablet_manager.cc:1428] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260807 19:54:59.375499 7345 ts_tablet_manager.cc:1428] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
W20260807 19:54:59.443149 6942 tablet.cc:2369] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:54:59.447434 7136 tablet.cc:2369] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:54:59.468869 7318 tablet.cc:2369] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:54:59.689608 7355 raft_consensus.cc:482] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:54:59.689927 7355 raft_consensus.cc:504] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.690346 7356 raft_consensus.cc:482] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:54:59.690611 7356 raft_consensus.cc:504] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.692307 7355 leader_election.cc:288] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d717cf2a2a24f42af094f5c9a33d5f0 (127.5.197.131:39157), c4f1b16b3b58415cb92b0d79d93be1b2 (127.5.197.130:37947)
I20260807 19:54:59.692508 7356 leader_election.cc:288] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d717cf2a2a24f42af094f5c9a33d5f0 (127.5.197.131:39157), ab663ff7517f43fcadb2e18e0e513b35 (127.5.197.129:33963)
I20260807 19:54:59.702329 7337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.692953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:45567 (local address 127.5.197.131:39157)
0807 19:54:59.693166 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.693172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.695130 (+ 1958us) server_negotiation.cc:407] Connection header received
0807 19:54:59.695210 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.695216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.695294 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.695375 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:54:59.696270 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.697395 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.699825 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.701042 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.701193 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.701267 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.701807 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.701962 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":74}
I20260807 19:54:59.703060 7357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.692875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39157 (local address 127.5.197.129:45567)
0807 19:54:59.694791 (+ 1916us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.694804 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.694944 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.695551 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.695557 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.695595 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:54:59.696037 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.696052 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.697563 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.697568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.699628 (+ 2060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.699644 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.701435 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.701442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.701615 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.701648 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.702583 (+ 935us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.702722 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1815,"thread_start_us":454,"threads_started":1}
I20260807 19:54:59.703766 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.693838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:39913 (local address 127.5.197.131:39157)
0807 19:54:59.695074 (+ 1236us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.695080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.695716 (+ 636us) server_negotiation.cc:407] Connection header received
0807 19:54:59.695940 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.695944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.696008 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.696093 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:54:59.697007 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.698133 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.700718 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.701990 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.702210 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.702268 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.703243 (+ 975us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.703389 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":585,"thread_start_us":345,"threads_started":1}
I20260807 19:54:59.704082 7359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.693313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39157 (local address 127.5.197.130:39913)
0807 19:54:59.695538 (+ 2225us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.695556 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.695773 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.696390 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.696396 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.696423 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:54:59.696835 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.696848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.698297 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.698302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.700527 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.700544 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.702443 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.702450 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.702641 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.702676 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.702762 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.702891 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2085,"thread_start_us":1895,"threads_started":1}
I20260807 19:54:59.704517 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7b49467387f4d4eae8fbdb1dd524184" candidate_uuid: "ab663ff7517f43fcadb2e18e0e513b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" is_pre_election: true
I20260807 19:54:59.705425 7258 raft_consensus.cc:2454] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab663ff7517f43fcadb2e18e0e513b35 in term 0.
I20260807 19:54:59.706445 6792 leader_election.cc:302] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d717cf2a2a24f42af094f5c9a33d5f0, ab663ff7517f43fcadb2e18e0e513b35; no voters:
I20260807 19:54:59.706931 7355 raft_consensus.cc:2781] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:54:59.707075 7355 raft_consensus.cc:482] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:54:59.707161 7355 raft_consensus.cc:3037] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:59.710512 7355 raft_consensus.cc:504] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.710986 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.695920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:37979 (local address 127.5.197.129:33963)
0807 19:54:59.696115 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.696121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.704407 (+ 8286us) server_negotiation.cc:407] Connection header received
0807 19:54:59.704661 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.704666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.704733 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.704792 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:54:59.705349 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.706327 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.708618 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.709864 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.710008 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.710075 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.710640 (+ 565us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.710768 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:54:59.711566 7359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.696195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:33963 (local address 127.5.197.130:37979)
0807 19:54:59.704306 (+ 8111us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.704324 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.704507 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.704985 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.704989 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.705016 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:54:59.705183 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.705194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.706509 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.706514 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.708422 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.708437 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.710244 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.710250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.710449 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.710484 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.711161 (+ 677us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.711305 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8007,"threads_started":1}
I20260807 19:54:59.711907 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7b49467387f4d4eae8fbdb1dd524184" candidate_uuid: "ab663ff7517f43fcadb2e18e0e513b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0"
I20260807 19:54:59.712040 7355 leader_election.cc:288] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [CANDIDATE]: Term 1 election: Requested vote from peers 0d717cf2a2a24f42af094f5c9a33d5f0 (127.5.197.131:39157), c4f1b16b3b58415cb92b0d79d93be1b2 (127.5.197.130:37947)
I20260807 19:54:59.712136 7258 raft_consensus.cc:3037] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:59.713687 6878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7b49467387f4d4eae8fbdb1dd524184" candidate_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab663ff7517f43fcadb2e18e0e513b35" is_pre_election: true
I20260807 19:54:59.714411 6878 raft_consensus.cc:2379] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4f1b16b3b58415cb92b0d79d93be1b2 in current term 1: Already voted for candidate ab663ff7517f43fcadb2e18e0e513b35 in this term.
I20260807 19:54:59.714586 7257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7b49467387f4d4eae8fbdb1dd524184" candidate_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" is_pre_election: true
I20260807 19:54:59.715238 7258 raft_consensus.cc:2454] T d7b49467387f4d4eae8fbdb1dd524184 P 0d717cf2a2a24f42af094f5c9a33d5f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab663ff7517f43fcadb2e18e0e513b35 in term 1.
I20260807 19:54:59.715797 6792 leader_election.cc:302] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d717cf2a2a24f42af094f5c9a33d5f0, ab663ff7517f43fcadb2e18e0e513b35; no voters:
I20260807 19:54:59.715914 6971 leader_election.cc:302] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4f1b16b3b58415cb92b0d79d93be1b2; no voters: 0d717cf2a2a24f42af094f5c9a33d5f0, ab663ff7517f43fcadb2e18e0e513b35
I20260807 19:54:59.716167 7355 raft_consensus.cc:2781] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:59.716333 7356 raft_consensus.cc:3037] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:59.716768 7355 raft_consensus.cc:686] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [term 1 LEADER]: Becoming Leader. State: Replica: ab663ff7517f43fcadb2e18e0e513b35, State: Running, Role: LEADER
I20260807 19:54:59.717367 7355 consensus_queue.cc:237] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } }
I20260807 19:54:59.719121 7356 raft_consensus.cc:2726] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 19:54:59.719748 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.712822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:41305 (local address 127.5.197.130:37947)
0807 19:54:59.713051 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.713057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.713077 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:54:59.713130 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.713135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.713199 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.713290 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:54:59.713975 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.715010 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.717472 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.718726 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.718892 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.718961 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.719353 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.719485 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 19:54:59.719825 7358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.692807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:37947 (local address 127.5.197.129:41305)
0807 19:54:59.694769 (+ 1962us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:59.694793 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:59.694974 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:59.713362 (+ 18388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:59.713368 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:59.713403 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:54:59.713805 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.713818 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.715205 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.715210 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.717266 (+ 2056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:59.717280 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.718995 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.719002 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:59.719174 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.719210 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:54:59.719307 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 19:54:59.719435 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1827,"spinlock_wait_cycles":21248,"thread_start_us":1209,"threads_started":1}
I20260807 19:54:59.721113 7071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7b49467387f4d4eae8fbdb1dd524184" candidate_uuid: "ab663ff7517f43fcadb2e18e0e513b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2"
I20260807 19:54:59.721045 7072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7b49467387f4d4eae8fbdb1dd524184" candidate_uuid: "ab663ff7517f43fcadb2e18e0e513b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" is_pre_election: true
I20260807 19:54:59.724273 7071 raft_consensus.cc:2454] T d7b49467387f4d4eae8fbdb1dd524184 P c4f1b16b3b58415cb92b0d79d93be1b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab663ff7517f43fcadb2e18e0e513b35 in term 1.
I20260807 19:54:59.724220 6684 catalog_manager.cc:5495] T d7b49467387f4d4eae8fbdb1dd524184 P ab663ff7517f43fcadb2e18e0e513b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab663ff7517f43fcadb2e18e0e513b35 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "ab663ff7517f43fcadb2e18e0e513b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d717cf2a2a24f42af094f5c9a33d5f0" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab663ff7517f43fcadb2e18e0e513b35" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4f1b16b3b58415cb92b0d79d93be1b2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 37947 } health_report { overall_health: UNKNOWN } } }
Aug 07 19:54:59 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:54:59.779769 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.764899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.5.197.129:33963)
0807 19:54:59.765076 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.765083 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.765578 (+ 495us) server_negotiation.cc:407] Connection header received
0807 19:54:59.765753 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.765757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.765834 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.765923 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:59.767460 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.768295 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.769567 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.769989 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.770100 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.774108 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:59.774124 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:59.774140 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:59.774176 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:59.777001 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.777646 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.777654 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.777656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.777787 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.778178 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.778182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.778184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.778555 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:59.778846 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.779156 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.779419 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 19:54:59 dist-test-slave-6bbx krb5kdc[6626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:54:59 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:54:59.831941 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.817797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59282 (local address 127.5.197.129:33963)
0807 19:54:59.817995 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.818002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.818348 (+ 346us) server_negotiation.cc:407] Connection header received
0807 19:54:59.818534 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.818538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.818604 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.818690 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:59.820077 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.820833 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.822063 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.822495 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.822608 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.826473 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:59.826478 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:59.826481 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:59.826519 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:59.829261 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.829962 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.829966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.829969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.830098 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.830520 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.830524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.830526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.830812 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:59.831081 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.831373 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.831599 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 19:54:59 dist-test-slave-6bbx krb5kdc[6626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:54:59 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:54:59.883384 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.869222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59298 (local address 127.5.197.129:33963)
0807 19:54:59.869507 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.869514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.869712 (+ 198us) server_negotiation.cc:407] Connection header received
0807 19:54:59.869874 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.869878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.869946 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.870034 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:59.871439 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.872230 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.873785 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.874234 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.874336 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.878222 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:59.878228 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:59.878231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:59.878274 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:59.880960 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.881622 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.881626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.881628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.881759 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.882048 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.882074 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.882077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.882398 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:59.882597 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.882832 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.883009 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
W20260807 19:54:59.885591 6823 tablet_service.cc:2908] Rejecting scan request for tablet d7b49467387f4d4eae8fbdb1dd524184: Uninitialized: clean time has not yet been initialized
I20260807 19:54:59.889421 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6770
I20260807 19:54:59.901883 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:59.890347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.5.197.129:33963)
0807 19:54:59.890532 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:59.890536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:59.890789 (+ 253us) server_negotiation.cc:407] Connection header received
0807 19:54:59.890890 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:59.890893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:59.890970 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:59.891054 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:59.892520 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.893263 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.894427 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:59.894827 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:59.894930 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:59.897193 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:59.897198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:59.897202 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:59.897233 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:59.899603 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.900283 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.900286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.900289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.900419 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:59.900767 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:59.900770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:59.900772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:59.901025 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:59.901237 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:59.901451 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 19:54:59.901628 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:54:59.902657 6933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:59.995755 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6770
I20260807 19:55:00.020444 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6947
Aug 07 19:55:00 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:55:00.036296 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:00.021306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52664 (local address 127.5.197.130:37947)
0807 19:55:00.021483 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:00.021487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:00.021506 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:55:00.021651 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:00.021655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:00.021742 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:00.021829 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:00.023265 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:00.024074 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:00.025504 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:00.025920 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:00.026013 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:00.030331 (+ 4318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:00.030347 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:00.030364 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:00.030401 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:00.033468 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:00.034159 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:00.034167 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:00.034170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:00.034300 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:00.034695 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:00.034699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:00.034701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:00.035088 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:00.035390 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:00.035735 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 19:55:00.035974 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:55:00.036972 7128 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:00.127839 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6947
I20260807 19:55:00.152212 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7141
Aug 07 19:55:00 dist-test-slave-6bbx krb5kdc[6626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:55:00.168025 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:00.153025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52646 (local address 127.5.197.131:39157)
0807 19:55:00.153216 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:00.153222 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:00.153300 (+ 78us) server_negotiation.cc:407] Connection header received
0807 19:55:00.153495 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:00.153499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:00.153579 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:00.153680 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:00.154994 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:00.155728 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:00.157035 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:00.157436 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:00.157551 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:00.162037 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:00.162056 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:00.162074 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:00.162118 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:00.165067 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:00.165891 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:00.165900 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:00.165903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:00.166050 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:00.166461 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:00.166465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:00.166467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:00.166837 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:00.167155 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:00.167443 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 19:55:00.167702 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:55:00.168708 7311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:00.257601 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 7141
I20260807 19:55:00.280730 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6642
I20260807 19:55:00.281970 6721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:00.394593 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6642
2026-08-07T19:55:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4674 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:00 dist-test-slave-6bbx krb5kdc[7391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:00 dist-test-slave-6bbx krb5kdc[7391](info): set up 2 sockets
Aug 07 19:55:00 dist-test-slave-6bbx krb5kdc[7391](info): commencing operation
krb5kdc: starting...
W20260807 19:55:01.593078 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:01 dist-test-slave-6bbx krb5kdc[7391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:01.815593 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33917
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:33917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:02.157372 7407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:02.157694 7407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:02.157797 7407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:02.165191 7407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:02.165326 7407 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 19:55:02.165369 7407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:02.165434 7407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:02.165486 7407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:02.165547 7407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:02.175772 7407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:33917
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:02.177143 7407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:02.178555 7407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:02.191148 7418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:02.191200 7421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:02.191110 7417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:02.192113 7407 server_base.cc:1034] running on GCE node
I20260807 19:55:02.192991 7407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:02.194530 7407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:02.195786 7407 hybrid_clock.cc:648] HybridClock initialized: now 1786132502195723 us; error 37 us; skew 500 ppm
I20260807 19:55:02.196113 7407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:02 dist-test-slave-6bbx krb5kdc[7391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132502, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:02.199381 7407 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:02.201085 7407 webserver.cc:460] Webserver started at http://127.5.197.190:46513/ using document root <none> and password file <none>
I20260807 19:55:02.201859 7407 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:02.201965 7407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:02.202505 7407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:02.205861 7407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "4151b3d65319463fadbb0bc5377c5f4f"
format_stamp: "Formatted at 2026-08-07 19:55:02 on dist-test-slave-6bbx"
server_key: "fd81fddcb0969f1e9b0173c9122db219"
server_key_iv: "2edf5335bcc468c7c678df0d3f954eb5"
server_key_version: "encryptionkey@0"
I20260807 19:55:02.206746 7407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "4151b3d65319463fadbb0bc5377c5f4f"
format_stamp: "Formatted at 2026-08-07 19:55:02 on dist-test-slave-6bbx"
server_key: "fd81fddcb0969f1e9b0173c9122db219"
server_key_iv: "2edf5335bcc468c7c678df0d3f954eb5"
server_key_version: "encryptionkey@0"
I20260807 19:55:02.212548 7407 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 19:55:02.216499 7431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:02.218036 7407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:02.218247 7407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "4151b3d65319463fadbb0bc5377c5f4f"
format_stamp: "Formatted at 2026-08-07 19:55:02 on dist-test-slave-6bbx"
server_key: "fd81fddcb0969f1e9b0173c9122db219"
server_key_iv: "2edf5335bcc468c7c678df0d3f954eb5"
server_key_version: "encryptionkey@0"
I20260807 19:55:02.218482 7407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:02.241473 7407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:02.246239 7407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:02.246536 7407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:02.269233 7407 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:33917
I20260807 19:55:02.269245 7510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:33917 every 8 connection(s)
I20260807 19:55:02.270682 7407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:02.274745 7511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:02.278764 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 7407
I20260807 19:55:02.279001 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:02.279614 5910 external_mini_cluster.cc:1428] Setting key d7abd7f69abcb534b12b59e338079833
I20260807 19:55:02.286635 7511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f: Bootstrap starting.
I20260807 19:55:02.290757 7511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:02.292107 7511 log.cc:824] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:55:02 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:02.295617 7511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f: No bootstrap required, opened a new log
I20260807 19:55:02.304618 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:02.281744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57490 (local address 127.5.197.190:33917)
0807 19:55:02.282627 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:02.282639 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:02.282684 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:55:02.284949 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:02.284981 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:02.285418 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:02.285767 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:02.287734 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.289129 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.290959 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.291755 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.291914 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:02.296685 (+ 4771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:02.296692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:02.296708 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:02.296747 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:02.299998 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:02.300983 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:02.300990 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:02.300998 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:02.301183 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:02.301610 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:02.301614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:02.301616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:02.302273 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:02.302503 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:02.303009 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 19:55:02.303425 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":392,"threads_started":1}
I20260807 19:55:02.305083 7511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4151b3d65319463fadbb0bc5377c5f4f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33917 } }
I20260807 19:55:02.305505 7511 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:02.305605 7511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4151b3d65319463fadbb0bc5377c5f4f, State: Initialized, Role: FOLLOWER
I20260807 19:55:02.306253 7511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4151b3d65319463fadbb0bc5377c5f4f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33917 } }
I20260807 19:55:02.306562 7511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:02.306707 7511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:02.306898 7511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:02.309738 7511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4151b3d65319463fadbb0bc5377c5f4f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33917 } }
I20260807 19:55:02.310403 7511 leader_election.cc:302] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4151b3d65319463fadbb0bc5377c5f4f; no voters:
I20260807 19:55:02.311035 7511 leader_election.cc:288] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:02.311167 7517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:02.311887 7517 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [term 1 LEADER]: Becoming Leader. State: Replica: 4151b3d65319463fadbb0bc5377c5f4f, State: Running, Role: LEADER
I20260807 19:55:02.312441 7517 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4151b3d65319463fadbb0bc5377c5f4f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33917 } }
I20260807 19:55:02.313223 7511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:02.315537 7519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4151b3d65319463fadbb0bc5377c5f4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4151b3d65319463fadbb0bc5377c5f4f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33917 } } }
I20260807 19:55:02.316049 7519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:02.315516 7520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4151b3d65319463fadbb0bc5377c5f4f. Latest consensus state: current_term: 1 leader_uuid: "4151b3d65319463fadbb0bc5377c5f4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4151b3d65319463fadbb0bc5377c5f4f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33917 } } }
I20260807 19:55:02.316416 7520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:02.317770 7525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:02.323710 7525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:02.333616 7525 catalog_manager.cc:1347] Generated new cluster ID: 0519d946675a4d959fe1a64962ead326
I20260807 19:55:02.333755 7525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:02.367321 7525 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:02.368804 7525 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:02.383888 7525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f: Generated new TSK 0
I20260807 19:55:02.385273 7525 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:55:02.446787 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33917
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:02.807160 7546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:02.807482 7546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:02.807610 7546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:02.815122 7546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:02.815263 7546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:02.815392 7546 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:02.815501 7546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:02.826051 7546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:33917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:02.827440 7546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:02.829020 7546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:02.842653 7555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:02.842594 7556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:02.842685 7559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:02.843499 7546 server_base.cc:1034] running on GCE node
I20260807 19:55:02.844206 7546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:02.845180 7546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:02.846421 7546 hybrid_clock.cc:648] HybridClock initialized: now 1786132502846347 us; error 41 us; skew 500 ppm
I20260807 19:55:02.846755 7546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:02 dist-test-slave-6bbx krb5kdc[7391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132502, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:02.853180 7546 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:55:02.854825 7546 webserver.cc:460] Webserver started at http://127.5.197.129:44591/ using document root <none> and password file <none>
I20260807 19:55:02.855582 7546 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:02.855726 7546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:02.856083 7546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:02.859396 7546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "e368eff0249c461e85c975f208882e2f"
format_stamp: "Formatted at 2026-08-07 19:55:02 on dist-test-slave-6bbx"
server_key: "37ff80e11b51477c6288784df188a432"
server_key_iv: "52335f5f11bc4a36edf1d7f1530aa058"
server_key_version: "encryptionkey@0"
I20260807 19:55:02.860339 7546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "e368eff0249c461e85c975f208882e2f"
format_stamp: "Formatted at 2026-08-07 19:55:02 on dist-test-slave-6bbx"
server_key: "37ff80e11b51477c6288784df188a432"
server_key_iv: "52335f5f11bc4a36edf1d7f1530aa058"
server_key_version: "encryptionkey@0"
I20260807 19:55:02.866078 7546 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:02.869957 7568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:02.871398 7546 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:02.871577 7546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "e368eff0249c461e85c975f208882e2f"
format_stamp: "Formatted at 2026-08-07 19:55:02 on dist-test-slave-6bbx"
server_key: "37ff80e11b51477c6288784df188a432"
server_key_iv: "52335f5f11bc4a36edf1d7f1530aa058"
server_key_version: "encryptionkey@0"
I20260807 19:55:02.871869 7546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:02.889094 7546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:02.893692 7546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:02.893972 7546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:02.897120 7546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:02.897243 7546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:02.897406 7546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:02.897480 7546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:02 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132502, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:02.921903 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:02.897563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58169 (local address 127.5.197.190:33917)
0807 19:55:02.898047 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:02.898054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:02.899322 (+ 1268us) server_negotiation.cc:407] Connection header received
0807 19:55:02.901926 (+ 2604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:02.901934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:02.902032 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:02.902176 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:02.904581 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.905568 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.908141 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.908811 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.908965 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:02.914328 (+ 5363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:02.914336 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:02.914341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:02.914392 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:02.917727 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:02.918869 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:02.918875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:02.918880 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:02.919018 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:02.919541 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:02.919546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:02.919550 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:02.919990 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:02.920149 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:02.921234 (+ 1085us) server_negotiation.cc:299] Negotiation successful
0807 19:55:02.921488 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":241,"threads_started":1}
I20260807 19:55:02.923713 7585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:02.898303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33917 (local address 127.5.197.129:58169)
0807 19:55:02.899140 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:02.899186 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:02.901496 (+ 2310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:02.902568 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:02.902580 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:02.903400 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:02.904350 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:02.904382 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.905761 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.905765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:02.907954 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:02.907976 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.909108 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.909117 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:02.909450 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:02.910313 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:02.910340 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:02.913987 (+ 3647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:02.917930 (+ 3943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:02.917942 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:02.917966 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:02.918710 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:02.919139 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:02.919145 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:02.919149 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:02.919413 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:02.920245 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:02.920252 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:02.920751 (+ 499us) client_negotiation.cc:769] Sending connection context
0807 19:55:02.921101 (+ 350us) client_negotiation.cc:240] Negotiation successful
0807 19:55:02.921764 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":344,"threads_started":1}
I20260807 19:55:02.939917 7546 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:33023
I20260807 19:55:02.939956 7728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:33023 every 8 connection(s)
I20260807 19:55:02.941375 7546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:02.943904 7729 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33917
I20260807 19:55:02.944162 7729 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:02.944929 7729 heartbeater.cc:511] Master 127.5.197.190:33917 requested a full tablet report, sending...
I20260807 19:55:02.946657 7700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:02.931557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33917 (local address 127.5.197.129:48853)
0807 19:55:02.932407 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:02.932429 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:02.932620 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:02.933029 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:02.933034 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:02.933832 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:02.934401 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:02.934418 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.935708 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.935715 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:02.937657 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:02.937673 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.938591 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.938599 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:02.938787 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:02.939544 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:02.939566 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:02.940603 (+ 1037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:02.944080 (+ 3477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:02.944086 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:02.944090 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:02.944613 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:02.944994 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:02.944999 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:02.945003 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:02.945174 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:02.945727 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:02.945731 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:02.945926 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 19:55:02.946081 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 19:55:02.946351 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":462,"threads_started":1}
I20260807 19:55:02.946833 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:02.931554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:48853 (local address 127.5.197.190:33917)
0807 19:55:02.931789 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:02.931797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:02.932548 (+ 751us) server_negotiation.cc:407] Connection header received
0807 19:55:02.932789 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:02.932795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:02.932884 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:02.932967 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:02.934656 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.935551 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.937830 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:02.938331 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:02.938469 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:02.940820 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:02.940825 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:02.940828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:02.940864 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:02.943949 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:02.944732 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:02.944738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:02.944742 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:02.944883 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:02.945284 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:02.945290 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:02.945293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:02.945615 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:02.945766 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:02.946217 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 19:55:02.946465 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:55:02.947396 7454 ts_manager.cc:194] Registered new tserver with Master: e368eff0249c461e85c975f208882e2f (127.5.197.129:33023)
I20260807 19:55:02.949090 7454 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:58169
I20260807 19:55:02.951107 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 7546
I20260807 19:55:02.951354 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:02.952076 5910 external_mini_cluster.cc:1428] Setting key 1dd5aacb317b6d5648a25267dba28e18
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:55:03.000154 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33917
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:03.349013 7733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:03.349349 7733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:03.349496 7733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:03.357015 7733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:03.357164 7733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:03.357296 7733 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:03.357412 7733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:03.367946 7733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:33917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:03.369488 7733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:03.370956 7733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:03.384747 7741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:03.384764 7742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:03.384789 7744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:03.385756 7733 server_base.cc:1034] running on GCE node
I20260807 19:55:03.386523 7733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:03.387622 7733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:03.388908 7733 hybrid_clock.cc:648] HybridClock initialized: now 1786132503388836 us; error 43 us; skew 500 ppm
I20260807 19:55:03.389276 7733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:03 dist-test-slave-6bbx krb5kdc[7391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132503, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:03.393301 7733 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:55:03.394874 7733 webserver.cc:460] Webserver started at http://127.5.197.130:36123/ using document root <none> and password file <none>
I20260807 19:55:03.395633 7733 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:03.395778 7733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:03.396116 7733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:03.399261 7733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "0e4c860783be42b9b0fce3fe88ef6975"
format_stamp: "Formatted at 2026-08-07 19:55:03 on dist-test-slave-6bbx"
server_key: "bc9900a919c39336229e93353cdf3636"
server_key_iv: "0fa7f21779c6c0297c3696c5bc80eff9"
server_key_version: "encryptionkey@0"
I20260807 19:55:03.400259 7733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "0e4c860783be42b9b0fce3fe88ef6975"
format_stamp: "Formatted at 2026-08-07 19:55:03 on dist-test-slave-6bbx"
server_key: "bc9900a919c39336229e93353cdf3636"
server_key_iv: "0fa7f21779c6c0297c3696c5bc80eff9"
server_key_version: "encryptionkey@0"
I20260807 19:55:03.405905 7733 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 19:55:03.409646 7751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:03.411257 7733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:03.411433 7733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "0e4c860783be42b9b0fce3fe88ef6975"
format_stamp: "Formatted at 2026-08-07 19:55:03 on dist-test-slave-6bbx"
server_key: "bc9900a919c39336229e93353cdf3636"
server_key_iv: "0fa7f21779c6c0297c3696c5bc80eff9"
server_key_version: "encryptionkey@0"
I20260807 19:55:03.411653 7733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:03.430258 7733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:03.434752 7733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:03.435029 7733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:03.437975 7733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:03.438076 7733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:03.438205 7733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:03.438270 7733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:03 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132503, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:03.461567 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.438542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:38003 (local address 127.5.197.190:33917)
0807 19:55:03.438755 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:03.438761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:03.440281 (+ 1520us) server_negotiation.cc:407] Connection header received
0807 19:55:03.443228 (+ 2947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:03.443234 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:03.443332 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:03.443429 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:03.445800 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.446852 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.449291 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.449872 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.449992 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.454160 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:03.454166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:03.454169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:03.454205 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:03.457194 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.458309 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.458316 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.458320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.458486 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.459106 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.459112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.459115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.459539 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:03.459848 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:03.460847 (+ 999us) server_negotiation.cc:299] Negotiation successful
0807 19:55:03.461132 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 19:55:03.462680 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.439114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33917 (local address 127.5.197.130:38003)
0807 19:55:03.440064 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:03.440115 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:03.442822 (+ 2707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:03.443787 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:03.443800 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:03.444652 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:03.445587 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.445619 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.447017 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.447022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.449134 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.449148 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.450140 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.450148 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.450479 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.451277 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:03.451327 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:03.453920 (+ 2593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:03.457356 (+ 3436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.457366 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.457390 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.458104 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.458612 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.458617 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.458624 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.458949 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.459771 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:03.459780 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:03.460353 (+ 573us) client_negotiation.cc:769] Sending connection context
0807 19:55:03.460696 (+ 343us) client_negotiation.cc:240] Negotiation successful
0807 19:55:03.461204 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":368,"threads_started":1}
I20260807 19:55:03.484683 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.469909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:37703 (local address 127.5.197.190:33917)
0807 19:55:03.470108 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:03.470114 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:03.470804 (+ 690us) server_negotiation.cc:407] Connection header received
0807 19:55:03.470944 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:03.470949 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:03.471042 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:03.471159 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:03.472247 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.473420 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.474735 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.475414 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.475532 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.477831 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:03.477839 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:03.477843 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:03.477886 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:03.481558 (+ 3672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.482256 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.482262 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.482266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.482454 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.482960 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.482966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.482968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.483462 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:03.483603 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:03.484097 (+ 494us) server_negotiation.cc:299] Negotiation successful
0807 19:55:03.484330 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:55:03.484812 7871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.470043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33917 (local address 127.5.197.130:37703)
0807 19:55:03.470680 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:03.470700 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:03.470839 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:03.471170 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:03.471173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:03.471615 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:03.472057 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.472081 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.473569 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.473573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.474595 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.474608 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.475607 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.475612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.475835 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.476587 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:03.476605 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:03.477625 (+ 1020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:03.481699 (+ 4074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.481703 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.481706 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.482131 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.482598 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.482603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.482606 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.482839 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.483585 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:03.483590 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:03.483832 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 19:55:03.483980 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 19:55:03.484352 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":334,"threads_started":1}
I20260807 19:55:03.490623 7733 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:46811
I20260807 19:55:03.490661 7914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:46811 every 8 connection(s)
I20260807 19:55:03.491937 7733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:03.493916 7916 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33917
I20260807 19:55:03.494143 7916 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:03.494190 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 7733
I20260807 19:55:03.494388 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:03.494812 5910 external_mini_cluster.cc:1428] Setting key 96b32a8333e9b91c08b4b91f16f51c1c
I20260807 19:55:03.494858 7916 heartbeater.cc:511] Master 127.5.197.190:33917 requested a full tablet report, sending...
I20260807 19:55:03.496253 7453 ts_manager.cc:194] Registered new tserver with Master: 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811)
I20260807 19:55:03.497152 7453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:38003
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:55:03.541031 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33917
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:03.865783 7923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:03.866071 7923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:03.866190 7923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:03.873131 7923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:03.873243 7923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:03.873361 7923 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:03.873471 7923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:03.882833 7923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:33917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:03.884059 7923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:03.885337 7923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:03.897619 7930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:03.897575 7933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:03.897656 7931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:03.898748 7923 server_base.cc:1034] running on GCE node
I20260807 19:55:03.899318 7923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:03.900269 7923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:03.901477 7923 hybrid_clock.cc:648] HybridClock initialized: now 1786132503901425 us; error 30 us; skew 500 ppm
I20260807 19:55:03.901749 7923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:03 dist-test-slave-6bbx krb5kdc[7391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132503, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:03.904816 7923 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:55:03.906227 7923 webserver.cc:460] Webserver started at http://127.5.197.131:42349/ using document root <none> and password file <none>
I20260807 19:55:03.906875 7923 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:03.906971 7923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:03.907276 7923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:03.910054 7923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "de2013a616a44e8bb7de3ae6cfc5dec5"
format_stamp: "Formatted at 2026-08-07 19:55:03 on dist-test-slave-6bbx"
server_key: "3ea0570d47ca2ff30362694ad6131d56"
server_key_iv: "6eaa024c4c2ed5a5eed6904903de9318"
server_key_version: "encryptionkey@0"
I20260807 19:55:03.910833 7923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "de2013a616a44e8bb7de3ae6cfc5dec5"
format_stamp: "Formatted at 2026-08-07 19:55:03 on dist-test-slave-6bbx"
server_key: "3ea0570d47ca2ff30362694ad6131d56"
server_key_iv: "6eaa024c4c2ed5a5eed6904903de9318"
server_key_version: "encryptionkey@0"
I20260807 19:55:03.915794 7923 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260807 19:55:03.919116 7942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:03.920534 7923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:03.920661 7923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "de2013a616a44e8bb7de3ae6cfc5dec5"
format_stamp: "Formatted at 2026-08-07 19:55:03 on dist-test-slave-6bbx"
server_key: "3ea0570d47ca2ff30362694ad6131d56"
server_key_iv: "6eaa024c4c2ed5a5eed6904903de9318"
server_key_version: "encryptionkey@0"
I20260807 19:55:03.920826 7923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:03.934715 7923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:03.938509 7923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:03.938728 7923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:03.941565 7923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:03.941656 7923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:03.941793 7923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:03.941859 7923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:03.952369 7729 heartbeater.cc:503] Master 127.5.197.190:33917 was elected leader, sending a full tablet report...
Aug 07 19:55:03 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132503, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:03.968982 7954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.942891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33917 (local address 127.5.197.131:37007)
0807 19:55:03.944263 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:03.944322 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:03.947253 (+ 2931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:03.948140 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:03.948151 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:03.948967 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:03.950054 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.950089 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.951515 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.951522 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.955058 (+ 3536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.955073 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.956061 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.956071 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.956315 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.957095 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:03.957120 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:03.959954 (+ 2834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:03.963565 (+ 3611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.963575 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.963601 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.964349 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.964748 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.964752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.964756 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.965093 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.965771 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:03.965784 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:03.966289 (+ 505us) client_negotiation.cc:769] Sending connection context
0807 19:55:03.966713 (+ 424us) client_negotiation.cc:240] Negotiation successful
0807 19:55:03.967337 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"thread_start_us":836,"threads_started":1}
I20260807 19:55:03.969805 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.942383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:37007 (local address 127.5.197.190:33917)
0807 19:55:03.942588 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:03.942595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:03.944458 (+ 1863us) server_negotiation.cc:407] Connection header received
0807 19:55:03.947608 (+ 3150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:03.947613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:03.947734 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:03.947822 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:03.950343 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.951304 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.955199 (+ 3895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.955782 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.955899 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.960316 (+ 4417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:03.960322 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:03.960325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:03.960364 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:03.963362 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.964488 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.964492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.964494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.964633 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.965228 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.965234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.965237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.965623 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:03.965823 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:03.969170 (+ 3347us) server_negotiation.cc:299] Negotiation successful
0807 19:55:03.969466 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:55:03.987632 7923 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:37431
I20260807 19:55:03.987694 8105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:37431 every 8 connection(s)
I20260807 19:55:03.989104 7923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:03.991719 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 7923
I20260807 19:55:03.991919 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:03.992111 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.977272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:53371 (local address 127.5.197.190:33917)
0807 19:55:03.977471 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:03.977476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:03.978257 (+ 781us) server_negotiation.cc:407] Connection header received
0807 19:55:03.978531 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:03.978537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:03.978608 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:03.978698 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:03.980214 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.980991 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.982802 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.983216 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.983330 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.985950 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:03.985955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:03.985958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:03.985991 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:03.989000 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.989927 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.989933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.989936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.990109 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:03.990529 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:03.990534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:03.990537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:03.990916 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:03.991061 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:03.991544 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 19:55:03.991783 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:55:03.992224 8076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:03.977443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33917 (local address 127.5.197.131:53371)
0807 19:55:03.978142 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:03.978164 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:03.978392 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:03.978924 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:03.978929 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:03.979575 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:03.980074 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.980090 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.981138 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.981144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.982655 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:03.982669 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:03.983403 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:03.983411 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:03.983584 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:03.984371 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:03.984404 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:03.985745 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:03.989136 (+ 3391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.989141 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.989146 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.989729 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.990245 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:03.990250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:03.990254 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:03.990382 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:03.991059 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:03.991064 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:03.991272 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 19:55:03.991443 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 19:55:03.991825 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":367,"threads_started":1}
I20260807 19:55:03.992483 5910 external_mini_cluster.cc:1428] Setting key 148a7d276de005d929484360fc39377c
I20260807 19:55:03.993309 8106 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33917
I20260807 19:55:03.993570 8106 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:03.994498 8106 heartbeater.cc:511] Master 127.5.197.190:33917 requested a full tablet report, sending...
I20260807 19:55:03.996037 7453 ts_manager.cc:194] Registered new tserver with Master: de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131:37431)
I20260807 19:55:03.996855 7453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:37007
I20260807 19:55:04.008538 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:55:04 dist-test-slave-6bbx krb5kdc[7391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132504, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:55:04 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132504, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:04.062817 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.048681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57504 (local address 127.5.197.190:33917)
0807 19:55:04.048940 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.048947 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.049197 (+ 250us) server_negotiation.cc:407] Connection header received
0807 19:55:04.049362 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.049367 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.049437 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.049527 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:04.050950 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.051792 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.053075 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.053488 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.053594 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.057545 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:04.057551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:04.057554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:04.057592 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:04.060305 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.061009 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.061013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.061016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.061156 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.061485 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.061488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.061490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.061762 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:04.061971 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.062281 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.062480 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 19:55:04.067294 7453 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:04.074766 7453 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:04.109186 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.088778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.5.197.129:33023)
0807 19:55:04.099000 (+ 10222us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.099010 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.100856 (+ 1846us) server_negotiation.cc:407] Connection header received
0807 19:55:04.100986 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.100993 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.101194 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.101394 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:04.102784 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.104351 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.106616 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.108027 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.108156 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.108389 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.108700 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.108883 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10026,"thread_start_us":9866,"threads_started":1}
I20260807 19:55:04.109297 8121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.088392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:33023 (local address 127.0.0.1:36526)
0807 19:55:04.100582 (+ 12190us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.100602 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.100720 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.101691 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.101699 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.101762 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:04.102545 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.102560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.104532 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.104539 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.106405 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.106421 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.108255 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.108261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.108469 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.108509 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.108640 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.108851 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12058,"mutex_wait_us":69,"spinlock_wait_cycles":2944,"thread_start_us":10683,"threads_started":1}
I20260807 19:55:04.109835 8123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.087774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:37431 (local address 127.0.0.1:44142)
0807 19:55:04.099593 (+ 11819us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.099658 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.099939 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.101695 (+ 1756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.101700 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.101774 (+ 74us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:04.102544 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.102560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.104909 (+ 2349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.104915 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.107087 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.107106 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.109014 (+ 1908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.109021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.109189 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.109222 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.109301 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.109432 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11452,"mutex_wait_us":71,"spinlock_wait_cycles":1792,"thread_start_us":12487,"threads_started":1}
I20260807 19:55:04.110651 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.088285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44142 (local address 127.5.197.131:37431)
0807 19:55:04.101039 (+ 12754us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.101048 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.101081 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:55:04.101184 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.101191 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.101465 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.101962 (+ 497us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:04.103196 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.104764 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.107291 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.108769 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.109863 (+ 1094us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.110102 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.110168 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.110336 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12567,"thread_start_us":12400,"threads_started":1}
I20260807 19:55:04.111379 8129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.101752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:46811 (local address 127.0.0.1:50936)
0807 19:55:04.103108 (+ 1356us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.103126 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.103338 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.104226 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.104230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.104255 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:04.104662 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.104673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.106484 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.106489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.108702 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.108719 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.110448 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.110454 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.110622 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.110655 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.110925 (+ 270us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.111055 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1229,"thread_start_us":1050,"threads_started":1}
I20260807 19:55:04.111472 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.101051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.5.197.130:46811)
0807 19:55:04.101685 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.101693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.103232 (+ 1539us) server_negotiation.cc:407] Connection header received
0807 19:55:04.103524 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.103533 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.103827 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.103995 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:04.104850 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.106304 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.108894 (+ 2590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.110266 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.110407 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.110604 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.111002 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.111183 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":320,"threads_started":1}
I20260807 19:55:04.113987 7636 tablet_service.cc:1467] Processing CreateTablet for tablet 680deed90d21442794c9610e4cac7735 (DEFAULT_TABLE table=test-table [id=6863ec4157f4496ebe56c0409b5d55b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:04.114913 7821 tablet_service.cc:1467] Processing CreateTablet for tablet 680deed90d21442794c9610e4cac7735 (DEFAULT_TABLE table=test-table [id=6863ec4157f4496ebe56c0409b5d55b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:04.115705 7636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 680deed90d21442794c9610e4cac7735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.115406 8011 tablet_service.cc:1467] Processing CreateTablet for tablet 680deed90d21442794c9610e4cac7735 (DEFAULT_TABLE table=test-table [id=6863ec4157f4496ebe56c0409b5d55b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:04.116226 7821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 680deed90d21442794c9610e4cac7735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.116822 8011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 680deed90d21442794c9610e4cac7735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.128634 8130 tablet_bootstrap.cc:492] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Bootstrap starting.
I20260807 19:55:04.132682 8130 tablet_bootstrap.cc:654] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.133770 8130 log.cc:824] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:04.136967 8131 tablet_bootstrap.cc:492] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Bootstrap starting.
I20260807 19:55:04.137288 8132 tablet_bootstrap.cc:492] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Bootstrap starting.
I20260807 19:55:04.138736 8130 tablet_bootstrap.cc:492] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: No bootstrap required, opened a new log
I20260807 19:55:04.139050 8130 ts_tablet_manager.cc:1397] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260807 19:55:04.141546 8131 tablet_bootstrap.cc:654] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.141603 8132 tablet_bootstrap.cc:654] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.142841 8131 log.cc:824] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:04.142942 8132 log.cc:824] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:04.145917 8132 tablet_bootstrap.cc:492] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: No bootstrap required, opened a new log
I20260807 19:55:04.146027 8131 tablet_bootstrap.cc:492] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: No bootstrap required, opened a new log
I20260807 19:55:04.146206 8132 ts_tablet_manager.cc:1397] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260807 19:55:04.146313 8131 ts_tablet_manager.cc:1397] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.005s
I20260807 19:55:04.149597 8130 raft_consensus.cc:348] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.150157 8130 raft_consensus.cc:374] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.150302 8130 raft_consensus.cc:729] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e4c860783be42b9b0fce3fe88ef6975, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.151108 8130 consensus_queue.cc:260] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.152534 7916 heartbeater.cc:503] Master 127.5.197.190:33917 was elected leader, sending a full tablet report...
I20260807 19:55:04.153343 8130 ts_tablet_manager.cc:1428] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 19:55:04.155014 8132 raft_consensus.cc:348] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.155386 8132 raft_consensus.cc:374] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.155488 8132 raft_consensus.cc:729] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de2013a616a44e8bb7de3ae6cfc5dec5, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.156124 8132 consensus_queue.cc:260] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.156415 8131 raft_consensus.cc:348] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.156913 8131 raft_consensus.cc:374] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.157075 8131 raft_consensus.cc:729] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e368eff0249c461e85c975f208882e2f, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.157255 8106 heartbeater.cc:503] Master 127.5.197.190:33917 was elected leader, sending a full tablet report...
I20260807 19:55:04.157711 8131 consensus_queue.cc:260] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.157943 8132 ts_tablet_manager.cc:1428] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260807 19:55:04.160874 8131 ts_tablet_manager.cc:1428] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260807 19:55:04.184371 8140 raft_consensus.cc:482] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:04.184686 8140 raft_consensus.cc:504] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.186425 8140 leader_election.cc:288] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131:37431), 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811)
I20260807 19:55:04.193492 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.186795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:37677 (local address 127.5.197.131:37431)
0807 19:55:04.186981 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.186985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.187428 (+ 443us) server_negotiation.cc:407] Connection header received
0807 19:55:04.187681 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.187687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.187774 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.187886 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:04.188651 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.189554 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.191575 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.192497 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.192625 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.192680 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.193097 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.193229 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:55:04.193571 8141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.186671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:37431 (local address 127.5.197.129:37677)
0807 19:55:04.187317 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.187338 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.187492 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.188034 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.188039 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.188064 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:04.188487 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.188503 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.189691 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.189696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.191410 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.191423 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.192709 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.192716 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.192907 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.192943 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.193042 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.193157 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"mutex_wait_us":23,"thread_start_us":321,"threads_started":1}
I20260807 19:55:04.193732 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.187728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:52549 (local address 127.5.197.130:46811)
0807 19:55:04.187941 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.187947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.188194 (+ 247us) server_negotiation.cc:407] Connection header received
0807 19:55:04.188345 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.188351 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.188428 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.188527 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:04.189128 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.190018 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.191939 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.192790 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.192948 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.193015 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.193368 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.193500 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 19:55:04.194010 7730 tablet.cc:2369] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:04.194080 8142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.187428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:46811 (local address 127.5.197.129:52549)
0807 19:55:04.188091 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.188106 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.188226 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.188546 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.188549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.188570 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:04.188948 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.188962 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.190166 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.190169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.191771 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.191787 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.193009 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.193016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.193185 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.193218 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.193314 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.193453 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":36,"thread_start_us":362,"threads_started":1}
I20260807 19:55:04.195104 8041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "680deed90d21442794c9610e4cac7735" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" is_pre_election: true
I20260807 19:55:04.195107 7849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "680deed90d21442794c9610e4cac7735" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e4c860783be42b9b0fce3fe88ef6975" is_pre_election: true
I20260807 19:55:04.195598 8041 raft_consensus.cc:2454] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 0.
I20260807 19:55:04.195598 7849 raft_consensus.cc:2454] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 0.
I20260807 19:55:04.196254 7569 leader_election.cc:302] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e4c860783be42b9b0fce3fe88ef6975, e368eff0249c461e85c975f208882e2f; no voters:
I20260807 19:55:04.196630 8140 raft_consensus.cc:2781] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:04.196763 8140 raft_consensus.cc:482] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:04.196877 8140 raft_consensus.cc:3037] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.199118 8140 raft_consensus.cc:504] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.199764 8140 leader_election.cc:288] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 election: Requested vote from peers de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131:37431), 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811)
I20260807 19:55:04.200229 8041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "680deed90d21442794c9610e4cac7735" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5"
I20260807 19:55:04.200309 7849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "680deed90d21442794c9610e4cac7735" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e4c860783be42b9b0fce3fe88ef6975"
I20260807 19:55:04.200455 8041 raft_consensus.cc:3037] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.200536 7849 raft_consensus.cc:3037] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.202823 7849 raft_consensus.cc:2454] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 1.
I20260807 19:55:04.202836 8041 raft_consensus.cc:2454] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 1.
I20260807 19:55:04.203227 7569 leader_election.cc:302] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e4c860783be42b9b0fce3fe88ef6975, e368eff0249c461e85c975f208882e2f; no voters:
I20260807 19:55:04.203559 8140 raft_consensus.cc:2781] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:04.204015 8140 raft_consensus.cc:686] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 1 LEADER]: Becoming Leader. State: Replica: e368eff0249c461e85c975f208882e2f, State: Running, Role: LEADER
I20260807 19:55:04.204506 8140 consensus_queue.cc:237] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } }
I20260807 19:55:04.209100 7454 catalog_manager.cc:5495] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e368eff0249c461e85c975f208882e2f (127.5.197.129). New cstate: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } health_report { overall_health: HEALTHY } } }
W20260807 19:55:04.241178 8107 tablet.cc:2369] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:55:04.243937 7917 tablet.cc:2369] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:04.251490 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.245696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36542 (local address 127.5.197.129:33023)
0807 19:55:04.245946 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.245953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.245975 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:55:04.246389 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.246393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.246493 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.246634 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:04.247037 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.247804 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.249150 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.249583 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.249707 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.250227 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.250858 (+ 631us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.251003 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.251132 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.251225 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:55:04.261893 7849 raft_consensus.cc:1261] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Refusing update from remote peer e368eff0249c461e85c975f208882e2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:04.262785 8041 raft_consensus.cc:1261] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Refusing update from remote peer e368eff0249c461e85c975f208882e2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:04.263111 8143 consensus_queue.cc:1035] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:04.263556 8140 consensus_queue.cc:1035] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:04.284098 8148 mvcc.cc:205] Tried to move back new op lower bound from 7315998737441800192 to 7315998737225437184. Current Snapshot: MvccSnapshot[applied={T|T < 7315998737441800192}]
I20260807 19:55:04.286456 8150 mvcc.cc:205] Tried to move back new op lower bound from 7315998737441800192 to 7315998737225437184. Current Snapshot: MvccSnapshot[applied={T|T < 7315998737441800192}]
I20260807 19:55:04.306227 7453 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:04.306614 7453 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:04.311081 7453 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f: Sending DeleteTablet for 3 replicas of tablet 680deed90d21442794c9610e4cac7735
I20260807 19:55:04.312959 7821 tablet_service.cc:1514] Processing DeleteTablet for tablet 680deed90d21442794c9610e4cac7735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:04 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:50936
I20260807 19:55:04.313054 8011 tablet_service.cc:1514] Processing DeleteTablet for tablet 680deed90d21442794c9610e4cac7735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:04 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:44142
I20260807 19:55:04.313036 7636 tablet_service.cc:1514] Processing DeleteTablet for tablet 680deed90d21442794c9610e4cac7735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:04 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:36526
I20260807 19:55:04.319353 7453 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:04.320199 7453 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:04.325093 8159 tablet_replica.cc:330] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: stopping tablet replica
I20260807 19:55:04.325524 8160 tablet_replica.cc:330] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: stopping tablet replica
I20260807 19:55:04.326092 8160 raft_consensus.cc:2229] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:04.326733 8159 raft_consensus.cc:2229] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:04.326880 8160 raft_consensus.cc:2258] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:04.328042 8159 raft_consensus.cc:2258] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:04.330516 8158 tablet_replica.cc:330] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: stopping tablet replica
I20260807 19:55:04.331022 8158 raft_consensus.cc:2229] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:04.331984 8158 raft_consensus.cc:2258] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:04.332264 8160 ts_tablet_manager.cc:1905] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:04.333611 8011 tablet_service.cc:1467] Processing CreateTablet for tablet ad5e6adf6bfc447da1e10e8a0b0728d5 (DEFAULT_TABLE table=test-table [id=aefb36f54b9445fcbfce9c143a050530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:04.334095 8011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5e6adf6bfc447da1e10e8a0b0728d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.334304 8158 ts_tablet_manager.cc:1905] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:04.339766 7820 tablet_service.cc:1467] Processing CreateTablet for tablet ad5e6adf6bfc447da1e10e8a0b0728d5 (DEFAULT_TABLE table=test-table [id=aefb36f54b9445fcbfce9c143a050530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:04.340399 7820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5e6adf6bfc447da1e10e8a0b0728d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.341670 8158 ts_tablet_manager.cc:1918] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:04.341890 8158 log.cc:1196] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/680deed90d21442794c9610e4cac7735
I20260807 19:55:04.342268 8159 ts_tablet_manager.cc:1905] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:04.342547 8158 ts_tablet_manager.cc:1939] T 680deed90d21442794c9610e4cac7735 P 0e4c860783be42b9b0fce3fe88ef6975: Deleting consensus metadata
I20260807 19:55:04.345527 7432 catalog_manager.cc:4841] TS 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811): tablet 680deed90d21442794c9610e4cac7735 (table test-table [id=6863ec4157f4496ebe56c0409b5d55b6]) successfully deleted
I20260807 19:55:04.346248 8160 ts_tablet_manager.cc:1918] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:04.346474 8160 log.cc:1196] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/680deed90d21442794c9610e4cac7735
I20260807 19:55:04.347078 8160 ts_tablet_manager.cc:1939] T 680deed90d21442794c9610e4cac7735 P e368eff0249c461e85c975f208882e2f: Deleting consensus metadata
I20260807 19:55:04.346688 7636 tablet_service.cc:1467] Processing CreateTablet for tablet ad5e6adf6bfc447da1e10e8a0b0728d5 (DEFAULT_TABLE table=test-table [id=aefb36f54b9445fcbfce9c143a050530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:04.348629 7636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5e6adf6bfc447da1e10e8a0b0728d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.349820 8159 ts_tablet_manager.cc:1918] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:04.350071 8159 log.cc:1196] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/680deed90d21442794c9610e4cac7735
I20260807 19:55:04.350697 8159 ts_tablet_manager.cc:1939] T 680deed90d21442794c9610e4cac7735 P de2013a616a44e8bb7de3ae6cfc5dec5: Deleting consensus metadata
I20260807 19:55:04.350708 8130 tablet_bootstrap.cc:492] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: Bootstrap starting.
I20260807 19:55:04.352029 8132 tablet_bootstrap.cc:492] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: Bootstrap starting.
I20260807 19:55:04.352499 8130 tablet_bootstrap.cc:654] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.353528 7432 catalog_manager.cc:4841] TS de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131:37431): tablet 680deed90d21442794c9610e4cac7735 (table test-table [id=6863ec4157f4496ebe56c0409b5d55b6]) successfully deleted
I20260807 19:55:04.353645 8132 tablet_bootstrap.cc:654] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.360100 7434 catalog_manager.cc:4841] TS e368eff0249c461e85c975f208882e2f (127.5.197.129:33023): tablet 680deed90d21442794c9610e4cac7735 (table test-table [id=6863ec4157f4496ebe56c0409b5d55b6]) successfully deleted
I20260807 19:55:04.362875 8131 tablet_bootstrap.cc:492] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: Bootstrap starting.
I20260807 19:55:04.364921 8131 tablet_bootstrap.cc:654] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.369462 8132 tablet_bootstrap.cc:492] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: No bootstrap required, opened a new log
I20260807 19:55:04.369617 8131 tablet_bootstrap.cc:492] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: No bootstrap required, opened a new log
I20260807 19:55:04.369655 8132 ts_tablet_manager.cc:1397] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.000s
I20260807 19:55:04.369791 8131 ts_tablet_manager.cc:1397] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 19:55:04.369827 8130 tablet_bootstrap.cc:492] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: No bootstrap required, opened a new log
I20260807 19:55:04.370085 8130 ts_tablet_manager.cc:1397] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.016s
I20260807 19:55:04.370565 8132 raft_consensus.cc:348] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.370818 8132 raft_consensus.cc:374] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.370689 8131 raft_consensus.cc:348] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.370919 8132 raft_consensus.cc:729] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de2013a616a44e8bb7de3ae6cfc5dec5, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.370944 8131 raft_consensus.cc:374] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.371047 8131 raft_consensus.cc:729] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e368eff0249c461e85c975f208882e2f, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.371243 8130 raft_consensus.cc:348] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.371286 8132 consensus_queue.cc:260] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.371578 8130 raft_consensus.cc:374] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.371775 8130 raft_consensus.cc:729] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e4c860783be42b9b0fce3fe88ef6975, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.372167 8130 consensus_queue.cc:260] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.372784 8131 consensus_queue.cc:260] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.373087 8132 ts_tablet_manager.cc:1428] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:04.373627 8130 ts_tablet_manager.cc:1428] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 19:55:04.374346 8131 ts_tablet_manager.cc:1428] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 19:55:04.515899 8139 raft_consensus.cc:482] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:04.516132 8139 raft_consensus.cc:504] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.517652 8139 leader_election.cc:288] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e368eff0249c461e85c975f208882e2f (127.5.197.129:33023), 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811)
I20260807 19:55:04.525508 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.518573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:51725 (local address 127.5.197.129:33023)
0807 19:55:04.518737 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.518742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.518926 (+ 184us) server_negotiation.cc:407] Connection header received
0807 19:55:04.519173 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.519178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.519304 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.519399 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:04.520051 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.521098 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.523050 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.524376 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.524563 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.524651 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.525018 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.525167 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:55:04.525621 8167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.517985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:33023 (local address 127.5.197.131:51725)
0807 19:55:04.518833 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.518848 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.519011 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.519443 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.519449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.519479 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:04.519864 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.519876 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.521220 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.521226 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.522887 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.522901 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.524557 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.524564 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.524825 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.524862 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.525006 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.525257 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":40,"thread_start_us":772,"threads_started":1}
I20260807 19:55:04.525707 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.518084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:47851 (local address 127.5.197.130:46811)
0807 19:55:04.518428 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.518434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.518740 (+ 306us) server_negotiation.cc:407] Connection header received
0807 19:55:04.519023 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.519028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.519122 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.519220 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:04.519767 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.520849 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.523289 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.524566 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.524713 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.524770 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.525309 (+ 539us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.525452 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260807 19:55:04.526342 8164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.517944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:46811 (local address 127.5.197.131:47851)
0807 19:55:04.518613 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.518640 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.518873 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.519236 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.519240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.519266 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:04.519546 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.519560 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.521010 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.521016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.523055 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.523071 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.524930 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.524935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.525123 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.525156 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.525879 (+ 723us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.526025 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":4,"thread_start_us":358,"threads_started":1}
I20260807 19:55:04.526978 7663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5e6adf6bfc447da1e10e8a0b0728d5" candidate_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e368eff0249c461e85c975f208882e2f" is_pre_election: true
I20260807 19:55:04.527323 7849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5e6adf6bfc447da1e10e8a0b0728d5" candidate_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e4c860783be42b9b0fce3fe88ef6975" is_pre_election: true
I20260807 19:55:04.527494 7663 raft_consensus.cc:2454] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de2013a616a44e8bb7de3ae6cfc5dec5 in term 0.
I20260807 19:55:04.527590 7849 raft_consensus.cc:2454] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de2013a616a44e8bb7de3ae6cfc5dec5 in term 0.
I20260807 19:55:04.528092 7943 leader_election.cc:302] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e4c860783be42b9b0fce3fe88ef6975, de2013a616a44e8bb7de3ae6cfc5dec5; no voters:
I20260807 19:55:04.528537 8139 raft_consensus.cc:2781] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:04.528656 8139 raft_consensus.cc:482] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:04.528751 8139 raft_consensus.cc:3037] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.530928 8139 raft_consensus.cc:504] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.531607 8139 leader_election.cc:288] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [CANDIDATE]: Term 1 election: Requested vote from peers e368eff0249c461e85c975f208882e2f (127.5.197.129:33023), 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811)
I20260807 19:55:04.532101 7663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5e6adf6bfc447da1e10e8a0b0728d5" candidate_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e368eff0249c461e85c975f208882e2f"
I20260807 19:55:04.532217 7849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5e6adf6bfc447da1e10e8a0b0728d5" candidate_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e4c860783be42b9b0fce3fe88ef6975"
I20260807 19:55:04.532338 7663 raft_consensus.cc:3037] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.532428 7849 raft_consensus.cc:3037] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.535421 7849 raft_consensus.cc:2454] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de2013a616a44e8bb7de3ae6cfc5dec5 in term 1.
I20260807 19:55:04.535714 7663 raft_consensus.cc:2454] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de2013a616a44e8bb7de3ae6cfc5dec5 in term 1.
I20260807 19:55:04.535914 7943 leader_election.cc:302] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e4c860783be42b9b0fce3fe88ef6975, de2013a616a44e8bb7de3ae6cfc5dec5; no voters:
I20260807 19:55:04.536247 8139 raft_consensus.cc:2781] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:04.536723 8139 raft_consensus.cc:686] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 LEADER]: Becoming Leader. State: Replica: de2013a616a44e8bb7de3ae6cfc5dec5, State: Running, Role: LEADER
I20260807 19:55:04.537161 8139 consensus_queue.cc:237] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.541105 7452 catalog_manager.cc:5495] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 reported cstate change: term changed from 0 to 1, leader changed from <none> to de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131). New cstate: current_term: 1 leader_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } health_report { overall_health: HEALTHY } } }
Aug 07 19:55:04 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132502, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:04.628739 8183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.614331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57518 (local address 127.5.197.190:33917)
0807 19:55:04.615138 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.615143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.615159 (+ 16us) server_negotiation.cc:407] Connection header received
0807 19:55:04.615205 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.615210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.615289 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.615391 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:04.616620 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.617417 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.618713 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.619182 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.619293 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.622870 (+ 3577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:04.622876 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:04.622879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:04.622908 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:04.625664 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.626654 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.626658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.626660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.626787 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.627264 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.627269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.627273 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.627571 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:04.627739 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.628256 (+ 517us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.628460 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":699,"thread_start_us":554,"threads_started":1}
I20260807 19:55:04.629194 8182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.614176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33917 (local address 127.0.0.1:57518)
0807 19:55:04.614699 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.614721 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.614882 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.615442 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.615451 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.616242 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:04.616481 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.616492 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.617569 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.617573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.618578 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.618591 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.619338 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.619344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.619528 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.620283 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:04.620302 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:04.622652 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:04.625808 (+ 3156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:04.625824 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:04.625833 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:04.626530 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:04.626909 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:04.626915 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:04.626918 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:04.627142 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:04.627751 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:04.627761 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:04.627986 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.628197 (+ 211us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.628645 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":116,"thread_start_us":266,"threads_started":1}
I20260807 19:55:04.635253 7452 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:57518:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 19:55:04.636675 7452 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:04.644198 7636 tablet_service.cc:1467] Processing CreateTablet for tablet dfdf2fa8becc41d59370d1e6b7dce0b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=71b2e97a8dcd4556a3190369680c92c5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:04.644342 7820 tablet_service.cc:1467] Processing CreateTablet for tablet dfdf2fa8becc41d59370d1e6b7dce0b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=71b2e97a8dcd4556a3190369680c92c5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:04.644685 8011 tablet_service.cc:1467] Processing CreateTablet for tablet dfdf2fa8becc41d59370d1e6b7dce0b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=71b2e97a8dcd4556a3190369680c92c5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:04.644933 7636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdf2fa8becc41d59370d1e6b7dce0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.644968 7820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdf2fa8becc41d59370d1e6b7dce0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.645223 8011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdf2fa8becc41d59370d1e6b7dce0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:04.653100 8130 tablet_bootstrap.cc:492] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: Bootstrap starting.
I20260807 19:55:04.654166 8131 tablet_bootstrap.cc:492] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: Bootstrap starting.
I20260807 19:55:04.654984 8130 tablet_bootstrap.cc:654] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.655704 8132 tablet_bootstrap.cc:492] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: Bootstrap starting.
I20260807 19:55:04.656216 8131 tablet_bootstrap.cc:654] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.657550 8132 tablet_bootstrap.cc:654] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:04.666421 8130 tablet_bootstrap.cc:492] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: No bootstrap required, opened a new log
I20260807 19:55:04.666639 8130 ts_tablet_manager.cc:1397] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260807 19:55:04.666985 8132 tablet_bootstrap.cc:492] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: No bootstrap required, opened a new log
I20260807 19:55:04.667173 8132 ts_tablet_manager.cc:1397] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.007s
I20260807 19:55:04.667506 8130 raft_consensus.cc:348] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.667819 8130 raft_consensus.cc:374] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.667912 8130 raft_consensus.cc:729] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e4c860783be42b9b0fce3fe88ef6975, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.667985 8132 raft_consensus.cc:348] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.668255 8132 raft_consensus.cc:374] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.668351 8132 raft_consensus.cc:729] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de2013a616a44e8bb7de3ae6cfc5dec5, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.668241 8130 consensus_queue.cc:260] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.668601 8132 consensus_queue.cc:260] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.668823 8138 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.669207 8132 ts_tablet_manager.cc:1428] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 19:55:04.669235 8138 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:04.669461 8131 tablet_bootstrap.cc:492] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: No bootstrap required, opened a new log
I20260807 19:55:04.669705 8131 ts_tablet_manager.cc:1397] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260807 19:55:04.670435 8130 ts_tablet_manager.cc:1428] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 19:55:04.671425 8131 raft_consensus.cc:348] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.671641 8131 raft_consensus.cc:374] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:04.671754 8131 raft_consensus.cc:729] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e368eff0249c461e85c975f208882e2f, State: Initialized, Role: FOLLOWER
I20260807 19:55:04.672020 8131 consensus_queue.cc:260] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.672554 8153 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.672734 8139 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.672931 8153 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:04.673017 8139 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:04.673462 8131 ts_tablet_manager.cc:1428] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260807 19:55:04.685678 8153 raft_consensus.cc:482] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:04.685933 8153 raft_consensus.cc:504] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.686710 8153 leader_election.cc:288] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811), de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131:37431)
I20260807 19:55:04.687351 7849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdf2fa8becc41d59370d1e6b7dce0b5" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e4c860783be42b9b0fce3fe88ef6975" is_pre_election: true
I20260807 19:55:04.687445 8041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdf2fa8becc41d59370d1e6b7dce0b5" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" is_pre_election: true
I20260807 19:55:04.687633 7849 raft_consensus.cc:2454] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 0.
I20260807 19:55:04.687801 8041 raft_consensus.cc:2454] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 0.
I20260807 19:55:04.688174 7569 leader_election.cc:302] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e4c860783be42b9b0fce3fe88ef6975, e368eff0249c461e85c975f208882e2f; no voters:
I20260807 19:55:04.688481 8153 raft_consensus.cc:2781] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:04.688637 8153 raft_consensus.cc:482] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:04.688732 8153 raft_consensus.cc:3037] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.692227 8153 raft_consensus.cc:504] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.692976 8153 leader_election.cc:288] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 election: Requested vote from peers 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811), de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131:37431)
I20260807 19:55:04.693500 7849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdf2fa8becc41d59370d1e6b7dce0b5" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e4c860783be42b9b0fce3fe88ef6975"
I20260807 19:55:04.693540 8041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdf2fa8becc41d59370d1e6b7dce0b5" candidate_uuid: "e368eff0249c461e85c975f208882e2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5"
I20260807 19:55:04.693766 8041 raft_consensus.cc:3037] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.693770 7849 raft_consensus.cc:3037] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:04.696278 8041 raft_consensus.cc:2454] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 1.
I20260807 19:55:04.696710 7569 leader_election.cc:302] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de2013a616a44e8bb7de3ae6cfc5dec5, e368eff0249c461e85c975f208882e2f; no voters:
I20260807 19:55:04.696709 7849 raft_consensus.cc:2454] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e368eff0249c461e85c975f208882e2f in term 1.
I20260807 19:55:04.697018 8153 raft_consensus.cc:2781] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:04.697183 8153 raft_consensus.cc:686] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [term 1 LEADER]: Becoming Leader. State: Replica: e368eff0249c461e85c975f208882e2f, State: Running, Role: LEADER
I20260807 19:55:04.697484 8153 consensus_queue.cc:237] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } }
I20260807 19:55:04.699334 8143 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: TxnStatusTablet state changed. Reason: New leader e368eff0249c461e85c975f208882e2f. Latest consensus state: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.699621 8143 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:04.700948 8189 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 19:55:04.701225 8189 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 19:55:04.700978 7452 catalog_manager.cc:5495] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e368eff0249c461e85c975f208882e2f (127.5.197.129). New cstate: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:04.723049 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.717228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36554 (local address 127.5.197.129:33023)
0807 19:55:04.717444 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.717449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.717469 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:55:04.717746 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.717750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.717819 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.717901 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:04.718379 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.719208 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.721153 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.721625 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.721728 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.722334 (+ 606us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.722437 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.722506 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.722676 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.722752 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:55:04.723095 8182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.717153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:33023 (local address 127.0.0.1:36554)
0807 19:55:04.717399 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.717421 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.717566 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.717945 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.717950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.717964 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:04.718165 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.718230 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.719333 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.719339 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.720984 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.721000 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.721795 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.721802 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.722005 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.722080 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.722540 (+ 460us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.722557 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.722629 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.722782 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 19:55:04.727507 8041 raft_consensus.cc:1261] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Refusing update from remote peer e368eff0249c461e85c975f208882e2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:04.727537 7849 raft_consensus.cc:1261] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Refusing update from remote peer e368eff0249c461e85c975f208882e2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:04.728197 8143 consensus_queue.cc:1035] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:04.728503 8153 consensus_queue.cc:1035] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:04.731371 8139 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: TxnStatusTablet state changed. Reason: New leader e368eff0249c461e85c975f208882e2f. Latest consensus state: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.731634 8139 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:04.735044 8143 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.735344 8143 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:04.735519 8147 mvcc.cc:205] Tried to move back new op lower bound from 7315998739357532160 to 7315998739243327488. Current Snapshot: MvccSnapshot[applied={T|T < 7315998739357532160}]
I20260807 19:55:04.735803 8139 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.736088 8139 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P de2013a616a44e8bb7de3ae6cfc5dec5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:04.742038 8138 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: TxnStatusTablet state changed. Reason: New leader e368eff0249c461e85c975f208882e2f. Latest consensus state: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.742404 8138 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:04.744218 8143 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.744467 8143 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P e368eff0249c461e85c975f208882e2f: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:04.744918 8138 tablet_replica.cc:439] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e368eff0249c461e85c975f208882e2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 } } peers { permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 } } peers { permanent_uuid: "de2013a616a44e8bb7de3ae6cfc5dec5" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37431 } } }
I20260807 19:55:04.745129 8138 tablet_replica.cc:442] T dfdf2fa8becc41d59370d1e6b7dce0b5 P 0e4c860783be42b9b0fce3fe88ef6975: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:04.755089 8197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.748784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44154 (local address 127.5.197.131:37431)
0807 19:55:04.749313 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.749317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.749336 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:55:04.749418 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.749422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.749495 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.749634 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:04.750017 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.750789 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.752687 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.753314 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.753435 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.753895 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.754450 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.754591 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.754691 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.754783 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":293,"threads_started":1}
I20260807 19:55:04.772032 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.766386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:46615 (local address 127.5.197.129:33023)
0807 19:55:04.766537 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.766542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.767196 (+ 654us) server_negotiation.cc:407] Connection header received
0807 19:55:04.767401 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.767407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.767475 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.767553 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:04.768098 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.768882 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.770238 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.770693 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.770802 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.771225 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.771349 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.771428 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.771583 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.771701 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 19:55:04.772086 8201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.766455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:33023 (local address 127.5.197.131:46615)
0807 19:55:04.767086 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.767101 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.767253 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.767584 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.767588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.767600 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:04.767952 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.767963 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.769011 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.769015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.770099 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.770111 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.770869 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.770875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.771005 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.771060 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.771447 (+ 387us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.771478 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.771548 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.771719 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":334,"threads_started":1}
I20260807 19:55:04.783120 7845 raft_consensus.cc:1261] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Refusing update from remote peer de2013a616a44e8bb7de3ae6cfc5dec5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:04.783680 7663 raft_consensus.cc:1261] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Refusing update from remote peer de2013a616a44e8bb7de3ae6cfc5dec5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:04.783874 8168 consensus_queue.cc:1035] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e4c860783be42b9b0fce3fe88ef6975" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:04.784407 8139 consensus_queue.cc:1035] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e368eff0249c461e85c975f208882e2f" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 33023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:04.823339 8197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.817420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:56927 (local address 127.5.197.131:37431)
0807 19:55:04.817584 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.817591 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.818096 (+ 505us) server_negotiation.cc:407] Connection header received
0807 19:55:04.818296 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.818302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.818371 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.818445 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:04.819064 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.820029 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.821559 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.822008 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.822115 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.822630 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.822761 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.822845 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.822967 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.823043 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 19:55:04.823558 8209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.817367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:37431 (local address 127.5.197.129:56927)
0807 19:55:04.817986 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:04.818006 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:04.818162 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:04.818480 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:04.818485 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:04.818501 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:04.818890 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.818905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.820210 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.820215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.821417 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:04.821430 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.822221 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.822229 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:04.822358 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.822432 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:04.822855 (+ 423us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:04.822867 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 19:55:04.822936 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 19:55:04.823069 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":315,"threads_started":1}
I20260807 19:55:04.864006 7453 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:04.864318 7453 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:04.868050 7453 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4151b3d65319463fadbb0bc5377c5f4f: Sending DeleteTablet for 3 replicas of tablet ad5e6adf6bfc447da1e10e8a0b0728d5
I20260807 19:55:04.869019 7636 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5e6adf6bfc447da1e10e8a0b0728d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:04 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:36526
I20260807 19:55:04.869805 8011 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5e6adf6bfc447da1e10e8a0b0728d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:04 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:44142
I20260807 19:55:04.870597 7820 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5e6adf6bfc447da1e10e8a0b0728d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:04 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:50936
I20260807 19:55:04.889292 8216 tablet_replica.cc:330] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: stopping tablet replica
I20260807 19:55:04.889562 8216 raft_consensus.cc:2229] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:04.889870 8216 raft_consensus.cc:2258] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:04.891639 8216 ts_tablet_manager.cc:1905] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:04.897082 8218 tablet_replica.cc:330] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: stopping tablet replica
I20260807 19:55:04.897460 8218 raft_consensus.cc:2229] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:04.898044 8217 tablet_replica.cc:330] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: stopping tablet replica
I20260807 19:55:04.898350 8218 raft_consensus.cc:2258] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:04.899581 8218 ts_tablet_manager.cc:1905] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:04.899904 8217 raft_consensus.cc:2229] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:04.900602 8217 raft_consensus.cc:2258] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:04.908268 8216 ts_tablet_manager.cc:1918] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:04.908445 8216 log.cc:1196] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/ad5e6adf6bfc447da1e10e8a0b0728d5
I20260807 19:55:04.908964 8216 ts_tablet_manager.cc:1939] T ad5e6adf6bfc447da1e10e8a0b0728d5 P e368eff0249c461e85c975f208882e2f: Deleting consensus metadata
I20260807 19:55:04.909201 8217 ts_tablet_manager.cc:1905] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:04.910302 7434 catalog_manager.cc:4841] TS e368eff0249c461e85c975f208882e2f (127.5.197.129:33023): tablet ad5e6adf6bfc447da1e10e8a0b0728d5 (table test-table [id=aefb36f54b9445fcbfce9c143a050530]) successfully deleted
Aug 07 19:55:04 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132504, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:04.917099 8218 ts_tablet_manager.cc:1918] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:04.918550 8218 log.cc:1196] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/ad5e6adf6bfc447da1e10e8a0b0728d5
I20260807 19:55:04.919157 8218 ts_tablet_manager.cc:1939] T ad5e6adf6bfc447da1e10e8a0b0728d5 P 0e4c860783be42b9b0fce3fe88ef6975: Deleting consensus metadata
I20260807 19:55:04.920696 8217 ts_tablet_manager.cc:1918] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:04.921237 7432 catalog_manager.cc:4841] TS 0e4c860783be42b9b0fce3fe88ef6975 (127.5.197.130:46811): tablet ad5e6adf6bfc447da1e10e8a0b0728d5 (table test-table [id=aefb36f54b9445fcbfce9c143a050530]) successfully deleted
I20260807 19:55:04.921707 8217 log.cc:1196] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/ad5e6adf6bfc447da1e10e8a0b0728d5
I20260807 19:55:04.922298 8217 ts_tablet_manager.cc:1939] T ad5e6adf6bfc447da1e10e8a0b0728d5 P de2013a616a44e8bb7de3ae6cfc5dec5: Deleting consensus metadata
I20260807 19:55:04.923617 7432 catalog_manager.cc:4841] TS de2013a616a44e8bb7de3ae6cfc5dec5 (127.5.197.131:37431): tablet ad5e6adf6bfc447da1e10e8a0b0728d5 (table test-table [id=aefb36f54b9445fcbfce9c143a050530]) successfully deleted
I20260807 19:55:04.924090 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.883393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36564 (local address 127.5.197.129:33023)
0807 19:55:04.883594 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.883601 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.890754 (+ 7153us) server_negotiation.cc:407] Connection header received
0807 19:55:04.896058 (+ 5304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.896065 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.896151 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.896230 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:04.898738 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.900019 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.901972 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.902717 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.902821 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.915213 (+ 12392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:04.915235 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:04.915259 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:04.915319 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:04.919694 (+ 4375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.920735 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.920746 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.920750 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.920924 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.921434 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.921443 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.921447 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.922035 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:04.922775 (+ 740us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.923423 (+ 648us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.923715 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 19:55:04.925873 7723 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36564
I20260807 19:55:04.947535 8183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.929667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57530 (local address 127.5.197.190:33917)
0807 19:55:04.929886 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.929892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.930490 (+ 598us) server_negotiation.cc:407] Connection header received
0807 19:55:04.930673 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.930679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.930766 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.930873 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:04.932573 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.933723 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.935542 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.936281 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.936408 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.939320 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:04.939327 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:04.939332 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:04.939374 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:04.942959 (+ 3585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.944014 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.944020 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.944024 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.944250 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.944730 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.944735 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.944739 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.945190 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:04.945418 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.946920 (+ 1502us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.947167 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 19:55:04.949249 7453 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57530
I20260807 19:55:04.951582 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7546
I20260807 19:55:04.994678 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:04.954636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36574 (local address 127.5.197.129:33023)
0807 19:55:04.954874 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:04.954880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:04.967178 (+ 12298us) server_negotiation.cc:407] Connection header received
0807 19:55:04.967756 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:04.967762 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:04.967856 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:04.967937 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:04.969818 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.971086 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.973207 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:04.974008 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:04.974108 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:04.977727 (+ 3619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:04.977735 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:04.977740 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:04.977783 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:04.981561 (+ 3778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.982433 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.982439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.982443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.982674 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:04.983133 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:04.983138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:04.983142 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:04.983476 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:04.983803 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:04.993944 (+ 10141us) server_negotiation.cc:299] Negotiation successful
0807 19:55:04.994239 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260807 19:55:04.995317 7723 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36574
W20260807 19:55:04.996068 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7546: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:04.996270 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 7546
I20260807 19:55:05.040920 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7733
Aug 07 19:55:05 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132504, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:55:05.057169 8226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:05.042036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50946 (local address 127.5.197.130:46811)
0807 19:55:05.042712 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:05.042716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:05.042733 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:55:05.042787 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:05.042791 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:05.042864 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:05.042962 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:05.044284 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:05.045043 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:05.046321 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:05.046708 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:05.046814 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:05.051275 (+ 4461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:05.051293 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:05.051310 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:05.051367 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:05.054366 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:05.055061 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:05.055069 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:05.055071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:05.055217 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:05.055582 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:05.055587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:05.055589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:05.056003 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:05.056312 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:05.056603 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 19:55:05.056835 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":391,"threads_started":1}
W20260807 19:55:05.057861 7910 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50946
W20260807 19:55:05.058528 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7733: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:05.058691 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 7733
I20260807 19:55:05.086280 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7923
Aug 07 19:55:05 dist-test-slave-6bbx krb5kdc[7391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132504, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:55:05.104034 8197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:05.087173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44170 (local address 127.5.197.131:37431)
0807 19:55:05.087371 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:05.087382 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:05.087404 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:55:05.087491 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:05.087496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:05.087592 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:05.087764 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:05.089014 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:05.090199 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:05.091345 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:05.092065 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:05.092197 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:05.096803 (+ 4606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:05.096823 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:05.096851 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:05.096903 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:05.100956 (+ 4053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:05.101751 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:05.101761 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:05.101764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:05.101951 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:05.102303 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:05.102308 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:05.102311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:05.102847 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:05.103165 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:05.103346 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 19:55:05.103590 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 19:55:05.104954 8101 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44170
W20260807 19:55:05.105711 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7923: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:05.105873 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 7923
I20260807 19:55:05.133025 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 7407
I20260807 19:55:05.134223 7506 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:05.252496 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 7407
2026-08-07T19:55:05Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4854 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:05 dist-test-slave-6bbx krb5kdc[8232](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:05 dist-test-slave-6bbx krb5kdc[8232](info): set up 2 sockets
Aug 07 19:55:05 dist-test-slave-6bbx krb5kdc[8232](info): commencing operation
krb5kdc: starting...
W20260807 19:55:06.431979 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:06 dist-test-slave-6bbx krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:06.649227 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:46231
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:46231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:06.973541 8249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:06.973871 8249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:06.973984 8249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:06.981379 8249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:06.981503 8249 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 19:55:06.981551 8249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:06.981613 8249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:06.981663 8249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:06.981724 8249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:06.991917 8249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:46231
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:46231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:06.993228 8249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:06.994561 8249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:07.006705 8256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:07.006788 8260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:07.006665 8257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:07.007613 8249 server_base.cc:1034] running on GCE node
I20260807 19:55:07.008490 8249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:07.009987 8249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:07.011212 8249 hybrid_clock.cc:648] HybridClock initialized: now 1786132507011139 us; error 39 us; skew 500 ppm
I20260807 19:55:07.011560 8249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:07 dist-test-slave-6bbx krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132507, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:07.014744 8249 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:07.016278 8249 webserver.cc:460] Webserver started at http://127.5.197.190:45973/ using document root <none> and password file <none>
I20260807 19:55:07.017083 8249 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:07.017191 8249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:07.017513 8249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:07.020648 8249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "289614602d6343ee980b034b34a24f8c"
format_stamp: "Formatted at 2026-08-07 19:55:07 on dist-test-slave-6bbx"
server_key: "9e7cc30157436dc9707f79b0d731686f"
server_key_iv: "f4f0671d512a1f6fbd15cdb1540bce91"
server_key_version: "encryptionkey@0"
I20260807 19:55:07.021437 8249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "289614602d6343ee980b034b34a24f8c"
format_stamp: "Formatted at 2026-08-07 19:55:07 on dist-test-slave-6bbx"
server_key: "9e7cc30157436dc9707f79b0d731686f"
server_key_iv: "f4f0671d512a1f6fbd15cdb1540bce91"
server_key_version: "encryptionkey@0"
I20260807 19:55:07.026826 8249 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:55:07.030357 8269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:07.031797 8249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:55:07.031968 8249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "289614602d6343ee980b034b34a24f8c"
format_stamp: "Formatted at 2026-08-07 19:55:07 on dist-test-slave-6bbx"
server_key: "9e7cc30157436dc9707f79b0d731686f"
server_key_iv: "f4f0671d512a1f6fbd15cdb1540bce91"
server_key_version: "encryptionkey@0"
I20260807 19:55:07.032187 8249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:07.055476 8249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:07.060194 8249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:07.060467 8249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:07.084051 8249 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:46231
I20260807 19:55:07.084057 8356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:46231 every 8 connection(s)
I20260807 19:55:07.085506 8249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:07.088771 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 8249
I20260807 19:55:07.088965 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:07.089560 8357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:07.089660 5910 external_mini_cluster.cc:1428] Setting key b456e92b7d6947e35a55539afd1b4245
I20260807 19:55:07.104498 8357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Bootstrap starting.
Aug 07 19:55:07 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:07.108276 8357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:07.109462 8357 log.cc:824] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:07.113029 8357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: No bootstrap required, opened a new log
I20260807 19:55:07.113971 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:07.091747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50758 (local address 127.5.197.190:46231)
0807 19:55:07.092628 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:07.092643 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:07.092685 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:55:07.094449 (+ 1764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:07.094476 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:07.094910 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:07.095286 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:07.097203 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.098504 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.100265 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.101030 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.101177 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:07.106167 (+ 4990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:07.106176 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:07.106192 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:07.106247 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:07.109367 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:07.110356 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:07.110366 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:07.110375 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:07.110647 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:07.111078 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:07.111082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:07.111084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:07.111650 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:07.111931 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:07.112493 (+ 562us) server_negotiation.cc:299] Negotiation successful
0807 19:55:07.112906 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":382,"threads_started":1}
I20260807 19:55:07.120867 8357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289614602d6343ee980b034b34a24f8c" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46231 } }
I20260807 19:55:07.121248 8357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:07.121348 8357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 289614602d6343ee980b034b34a24f8c, State: Initialized, Role: FOLLOWER
I20260807 19:55:07.122000 8357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289614602d6343ee980b034b34a24f8c" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46231 } }
I20260807 19:55:07.122291 8357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:07.122457 8357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:07.122624 8357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:07.124930 8357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289614602d6343ee980b034b34a24f8c" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46231 } }
I20260807 19:55:07.125466 8357 leader_election.cc:302] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 289614602d6343ee980b034b34a24f8c; no voters:
I20260807 19:55:07.126047 8357 leader_election.cc:288] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:07.126180 8363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:07.126880 8363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [term 1 LEADER]: Becoming Leader. State: Replica: 289614602d6343ee980b034b34a24f8c, State: Running, Role: LEADER
I20260807 19:55:07.127527 8363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289614602d6343ee980b034b34a24f8c" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46231 } }
I20260807 19:55:07.128281 8357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:07.130496 8364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "289614602d6343ee980b034b34a24f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289614602d6343ee980b034b34a24f8c" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46231 } } }
I20260807 19:55:07.130877 8364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:07.132134 8368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 289614602d6343ee980b034b34a24f8c. Latest consensus state: current_term: 1 leader_uuid: "289614602d6343ee980b034b34a24f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289614602d6343ee980b034b34a24f8c" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46231 } } }
I20260807 19:55:07.132443 8368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:07.133464 8376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:07.138177 8376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:07.146863 8376 catalog_manager.cc:1347] Generated new cluster ID: 4ab6305431b54e009da848c73828e3ba
I20260807 19:55:07.146981 8376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:07.168447 8376 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:07.169845 8376 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:07.180996 8376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Generated new TSK 0
I20260807 19:55:07.181916 8376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:55:07.243396 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:46231
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:07.616794 8394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:07.617112 8394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:07.617257 8394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:07.624781 8394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:07.624913 8394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:07.625036 8394 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 19:55:07.625098 8394 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:07.625197 8394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:07.635574 8394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:46231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:07.637025 8394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:07.638427 8394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:07.651576 8403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:07.651620 8405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:07.651646 8408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:07.652717 8394 server_base.cc:1034] running on GCE node
I20260807 19:55:07.653388 8394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:07.654321 8394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:07.655517 8394 hybrid_clock.cc:648] HybridClock initialized: now 1786132507655458 us; error 50 us; skew 500 ppm
I20260807 19:55:07.655866 8394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:07 dist-test-slave-6bbx krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132507, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:07.659165 8394 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:55:07.660871 8394 webserver.cc:460] Webserver started at http://127.5.197.129:38941/ using document root <none> and password file <none>
I20260807 19:55:07.661597 8394 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:07.661728 8394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:07.662052 8394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:07.665215 8394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "6c5de025f11643acab2bf7e709a90188"
format_stamp: "Formatted at 2026-08-07 19:55:07 on dist-test-slave-6bbx"
server_key: "b0f06f80c999c5a34f33b9a7fc62bfba"
server_key_iv: "da873841404548e04ececba24a4a1c04"
server_key_version: "encryptionkey@0"
I20260807 19:55:07.665997 8394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "6c5de025f11643acab2bf7e709a90188"
format_stamp: "Formatted at 2026-08-07 19:55:07 on dist-test-slave-6bbx"
server_key: "b0f06f80c999c5a34f33b9a7fc62bfba"
server_key_iv: "da873841404548e04ececba24a4a1c04"
server_key_version: "encryptionkey@0"
I20260807 19:55:07.671379 8394 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:55:07.674995 8419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:07.676393 8394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:07.676553 8394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "6c5de025f11643acab2bf7e709a90188"
format_stamp: "Formatted at 2026-08-07 19:55:07 on dist-test-slave-6bbx"
server_key: "b0f06f80c999c5a34f33b9a7fc62bfba"
server_key_iv: "da873841404548e04ececba24a4a1c04"
server_key_version: "encryptionkey@0"
I20260807 19:55:07.676738 8394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:07.694106 8394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:07.698407 8394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:07.698688 8394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:07.701696 8394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:07.701834 8394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:07.701967 8394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:07.702044 8394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:07 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132507, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:07.725675 8432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:07.702122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:47957 (local address 127.5.197.190:46231)
0807 19:55:07.703016 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:07.703021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:07.703873 (+ 852us) server_negotiation.cc:407] Connection header received
0807 19:55:07.705941 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:07.705947 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:07.706033 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:07.706135 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:07.708370 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.709444 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.712492 (+ 3048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.712904 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.713015 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:07.718374 (+ 5359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:07.718380 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:07.718383 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:07.718421 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:07.721693 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:07.722879 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:07.722886 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:07.722890 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:07.723046 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:07.723655 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:07.723687 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:07.723691 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:07.724084 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:07.724246 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:07.725039 (+ 793us) server_negotiation.cc:299] Negotiation successful
0807 19:55:07.725294 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":660,"threads_started":1}
I20260807 19:55:07.726770 8433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:07.702843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:46231 (local address 127.5.197.129:47957)
0807 19:55:07.703706 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:07.703749 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:07.705626 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:07.706396 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:07.706404 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:07.707178 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:07.708151 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:07.708180 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.709662 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.709668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:07.712316 (+ 2648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:07.712338 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.713164 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.713173 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:07.713498 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:07.714422 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:07.714460 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:07.718041 (+ 3581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:07.721868 (+ 3827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:07.721878 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:07.721899 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:07.722700 (+ 801us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:07.723174 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:07.723179 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:07.723183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:07.723525 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:07.724212 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:07.724220 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:07.724631 (+ 411us) client_negotiation.cc:769] Sending connection context
0807 19:55:07.724896 (+ 265us) client_negotiation.cc:240] Negotiation successful
0807 19:55:07.725486 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":353,"threads_started":1}
I20260807 19:55:07.747642 8432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:07.732764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:36831 (local address 127.5.197.190:46231)
0807 19:55:07.732968 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:07.732975 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:07.733920 (+ 945us) server_negotiation.cc:407] Connection header received
0807 19:55:07.734131 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:07.734134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:07.734248 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:07.734344 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:07.735698 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.736608 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.738631 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.739232 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.739351 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:07.741654 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:07.741661 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:07.741666 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:07.741710 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:07.744924 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:07.745597 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:07.745603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:07.745607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:07.745753 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:07.746114 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:07.746119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:07.746123 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:07.746418 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:07.746557 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:07.747016 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 19:55:07.747241 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:55:07.747733 8521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:07.732782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:46231 (local address 127.5.197.129:36831)
0807 19:55:07.733825 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:07.733847 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:07.734019 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:07.734446 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:07.734451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:07.735216 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:07.735523 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:07.735533 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.736793 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.736802 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:07.738419 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:07.738441 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:07.739441 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:07.739448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:07.739602 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:07.740295 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:07.740313 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:07.741435 (+ 1122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:07.745065 (+ 3630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:07.745071 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:07.745076 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:07.745480 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:07.745865 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:07.745870 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:07.745874 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:07.746010 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:07.746535 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:07.746540 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:07.746743 (+ 203us) client_negotiation.cc:769] Sending connection context
0807 19:55:07.746878 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 19:55:07.747236 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"thread_start_us":598,"threads_started":1}
I20260807 19:55:07.753720 8582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:43379 every 8 connection(s)
I20260807 19:55:07.753715 8394 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:43379
I20260807 19:55:07.754988 8394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:07.757090 8586 heartbeater.cc:347] Connected to a master server at 127.5.197.190:46231
I20260807 19:55:07.757320 8586 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:07.757952 8586 heartbeater.cc:511] Master 127.5.197.190:46231 requested a full tablet report, sending...
I20260807 19:55:07.759976 8294 ts_manager.cc:194] Registered new tserver with Master: 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379)
I20260807 19:55:07.761560 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 8394
I20260807 19:55:07.761679 8294 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:47957
I20260807 19:55:07.761785 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:07.762634 5910 external_mini_cluster.cc:1428] Setting key 9ada45aae3b3ef896519938dd6489590
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:55:07.807782 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:46231
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:08.152432 8591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:08.152760 8591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:08.152917 8591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:08.160372 8591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:08.160522 8591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:08.160624 8591 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 19:55:08.160678 8591 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:08.160749 8591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:08.170898 8591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:46231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:08.172338 8591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:08.173676 8591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:08.186883 8596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:08.186883 8597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:08.186921 8599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:08.187969 8591 server_base.cc:1034] running on GCE node
I20260807 19:55:08.188617 8591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:08.189589 8591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:08.190843 8591 hybrid_clock.cc:648] HybridClock initialized: now 1786132508190774 us; error 57 us; skew 500 ppm
I20260807 19:55:08.191169 8591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:08 dist-test-slave-6bbx krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132508, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:08.197638 8591 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:55:08.199231 8591 webserver.cc:460] Webserver started at http://127.5.197.130:44657/ using document root <none> and password file <none>
I20260807 19:55:08.200011 8591 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:08.200132 8591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:08.200474 8591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:08.203603 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "295a54b990db4f49a59453b22f6d99a0"
format_stamp: "Formatted at 2026-08-07 19:55:08 on dist-test-slave-6bbx"
server_key: "b4acb86c29cf8fcd71a38dc228e71ee5"
server_key_iv: "ae39effc53222120edfae3a6242624af"
server_key_version: "encryptionkey@0"
I20260807 19:55:08.204435 8591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "295a54b990db4f49a59453b22f6d99a0"
format_stamp: "Formatted at 2026-08-07 19:55:08 on dist-test-slave-6bbx"
server_key: "b4acb86c29cf8fcd71a38dc228e71ee5"
server_key_iv: "ae39effc53222120edfae3a6242624af"
server_key_version: "encryptionkey@0"
I20260807 19:55:08.209949 8591 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:08.213598 8606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:08.214967 8591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:08.215137 8591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "295a54b990db4f49a59453b22f6d99a0"
format_stamp: "Formatted at 2026-08-07 19:55:08 on dist-test-slave-6bbx"
server_key: "b4acb86c29cf8fcd71a38dc228e71ee5"
server_key_iv: "ae39effc53222120edfae3a6242624af"
server_key_version: "encryptionkey@0"
I20260807 19:55:08.215340 8591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:08.246194 8591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:08.250805 8591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:08.251082 8591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:08.253996 8591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:08.254104 8591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:08.254217 8591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:08.254294 8591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:08 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132508, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:08.278885 8621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.255342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:46231 (local address 127.5.197.130:58495)
0807 19:55:08.256230 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:08.256280 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:08.258235 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:08.259107 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:08.259120 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:08.260067 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:08.261182 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.261216 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.262802 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.262808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.264518 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.264535 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.265711 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.265717 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.265917 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.266649 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:08.266672 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:08.269910 (+ 3238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:08.273762 (+ 3852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.273772 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.273796 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.274498 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.275000 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.275005 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.275007 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.275243 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.275815 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:08.275823 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:08.276349 (+ 526us) client_negotiation.cc:769] Sending connection context
0807 19:55:08.276658 (+ 309us) client_negotiation.cc:240] Negotiation successful
0807 19:55:08.277274 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":378,"threads_started":1}
I20260807 19:55:08.280045 8620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.254678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:58495 (local address 127.5.197.190:46231)
0807 19:55:08.255183 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.255189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.256427 (+ 1238us) server_negotiation.cc:407] Connection header received
0807 19:55:08.258542 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.258548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.258643 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.258754 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:08.261476 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.262649 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.264667 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.265257 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.265389 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.270170 (+ 4781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:08.270176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:08.270181 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:08.270229 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:08.273559 (+ 3330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.274670 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.274675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.274679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.274852 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.275371 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.275376 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.275380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.275660 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:08.275843 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.279473 (+ 3630us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.279767 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":262,"threads_started":1}
I20260807 19:55:08.301258 8620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.286249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:42387 (local address 127.5.197.190:46231)
0807 19:55:08.286442 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.286448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.287115 (+ 667us) server_negotiation.cc:407] Connection header received
0807 19:55:08.287317 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.287321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.287406 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.287487 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:08.289068 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.289933 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.292068 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.292508 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.292608 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.294987 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:08.294992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:08.294995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:08.295027 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:08.298210 (+ 3183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.299095 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.299100 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.299104 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.299280 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.299784 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.299788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.299790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.300134 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:08.300294 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.300823 (+ 529us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.301027 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:55:08.301632 8727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.286307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:46231 (local address 127.5.197.130:42387)
0807 19:55:08.286986 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:08.287009 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:08.287180 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:08.287538 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:08.287543 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:08.288299 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:08.288815 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.288832 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.290084 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.290090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.291904 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.291924 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.292708 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.292714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.292910 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.293583 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:08.293607 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:08.294783 (+ 1176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:08.298375 (+ 3592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.298384 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.298388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.298961 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.299440 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.299446 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.299450 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.299642 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.300287 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:08.300293 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:08.300529 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 19:55:08.300689 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 19:55:08.301106 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":338,"threads_started":1}
I20260807 19:55:08.302971 8591 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:38687
I20260807 19:55:08.303007 8768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:38687 every 8 connection(s)
I20260807 19:55:08.304399 8591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:08.306586 8769 heartbeater.cc:347] Connected to a master server at 127.5.197.190:46231
I20260807 19:55:08.306794 8769 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:08.307479 8769 heartbeater.cc:511] Master 127.5.197.190:46231 requested a full tablet report, sending...
I20260807 19:55:08.308853 8294 ts_manager.cc:194] Registered new tserver with Master: 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687)
I20260807 19:55:08.309680 8294 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:58495
I20260807 19:55:08.310400 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 8591
I20260807 19:55:08.310576 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:08.311046 5910 external_mini_cluster.cc:1428] Setting key 9e86924603e5a5e75b89a7e802cd34cf
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:55:08.358929 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:46231
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:08.703296 8774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:08.703606 8774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:08.703780 8774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:08.711248 8774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:08.711370 8774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:08.711486 8774 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 19:55:08.711555 8774 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:08.711684 8774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:08.722165 8774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:46231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:08.723568 8774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:08.725044 8774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:08.738754 8780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:08.738797 8784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:08.738934 8789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:08.739645 8774 server_base.cc:1034] running on GCE node
I20260807 19:55:08.740342 8774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:08.741307 8774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:08.742545 8774 hybrid_clock.cc:648] HybridClock initialized: now 1786132508742490 us; error 33 us; skew 500 ppm
I20260807 19:55:08.742868 8774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:08 dist-test-slave-6bbx krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132508, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:08.746206 8774 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:55:08.747781 8774 webserver.cc:460] Webserver started at http://127.5.197.131:42569/ using document root <none> and password file <none>
I20260807 19:55:08.748493 8774 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:08.748598 8774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:08.748879 8774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:08.752058 8774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "c84ffdb7b420454cb724518f234b3ca9"
format_stamp: "Formatted at 2026-08-07 19:55:08 on dist-test-slave-6bbx"
server_key: "46a5ee153ad49c025f5d68c18c09c646"
server_key_iv: "2bf95fd8cfcf752aaf4eba174f791167"
server_key_version: "encryptionkey@0"
I20260807 19:55:08.752846 8774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "c84ffdb7b420454cb724518f234b3ca9"
format_stamp: "Formatted at 2026-08-07 19:55:08 on dist-test-slave-6bbx"
server_key: "46a5ee153ad49c025f5d68c18c09c646"
server_key_iv: "2bf95fd8cfcf752aaf4eba174f791167"
server_key_version: "encryptionkey@0"
I20260807 19:55:08.758913 8774 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 19:55:08.762966 8800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:08.764469 8774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 19:55:08.764669 8774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "c84ffdb7b420454cb724518f234b3ca9"
format_stamp: "Formatted at 2026-08-07 19:55:08 on dist-test-slave-6bbx"
server_key: "46a5ee153ad49c025f5d68c18c09c646"
server_key_iv: "2bf95fd8cfcf752aaf4eba174f791167"
server_key_version: "encryptionkey@0"
I20260807 19:55:08.764914 8586 heartbeater.cc:503] Master 127.5.197.190:46231 was elected leader, sending a full tablet report...
I20260807 19:55:08.764871 8774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:08.797463 8774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:08.802186 8774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:08.802474 8774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:08.805560 8774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:08.805685 8774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:08.805843 8774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:08.805956 8774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:08 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132508, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:08.831156 8814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.805936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:41279 (local address 127.5.197.190:46231)
0807 19:55:08.806602 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.806609 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.807779 (+ 1170us) server_negotiation.cc:407] Connection header received
0807 19:55:08.809879 (+ 2100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.809886 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.809988 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.810115 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:08.812396 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.813399 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.816492 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.817017 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.817160 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.822717 (+ 5557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:08.822726 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:08.822731 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:08.822780 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:08.826570 (+ 3790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.827856 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.827864 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.827868 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.828064 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.828664 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.828670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.828674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.829087 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:08.829242 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.830449 (+ 1207us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.830733 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":287,"threads_started":1}
I20260807 19:55:08.833000 8816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.806673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:46231 (local address 127.5.197.131:41279)
0807 19:55:08.807560 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:08.807622 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:08.809565 (+ 1943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:08.810386 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:08.810395 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:08.811185 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:08.812191 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.812218 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.813616 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.813622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.816305 (+ 2683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.816325 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.817362 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.817376 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.817712 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.818652 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:08.818683 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:08.822351 (+ 3668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:08.826784 (+ 4433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.826799 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.826822 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.827657 (+ 835us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.828215 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.828220 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.828224 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.828527 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.829220 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:08.829230 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:08.829853 (+ 623us) client_negotiation.cc:769] Sending connection context
0807 19:55:08.830270 (+ 417us) client_negotiation.cc:240] Negotiation successful
0807 19:55:08.830958 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":330,"threads_started":1}
I20260807 19:55:08.857225 8774 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:46727
I20260807 19:55:08.857240 8971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:46727 every 8 connection(s)
I20260807 19:55:08.859032 8774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:08.861665 8974 heartbeater.cc:347] Connected to a master server at 127.5.197.190:46231
I20260807 19:55:08.861954 8974 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:08.862854 8974 heartbeater.cc:511] Master 127.5.197.190:46231 requested a full tablet report, sending...
I20260807 19:55:08.863252 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 8774
I20260807 19:55:08.863426 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:08.863951 5910 external_mini_cluster.cc:1428] Setting key 6c8fc43f10feb628757742eba623ec6c
I20260807 19:55:08.864670 8294 ts_manager.cc:194] Registered new tserver with Master: c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:08.865820 8294 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:41279
I20260807 19:55:08.867609 8814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.844380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:34205 (local address 127.5.197.190:46231)
0807 19:55:08.844589 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.844596 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.851699 (+ 7103us) server_negotiation.cc:407] Connection header received
0807 19:55:08.852057 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.852064 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.852163 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.852252 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:08.854160 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.855347 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.857477 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.858099 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.858220 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.861112 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:08.861119 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:08.861124 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:08.861167 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:08.864745 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.865562 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.865568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.865571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.865712 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.866142 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.866148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.866151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.866454 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:08.866570 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.867078 (+ 508us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.867377 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:55:08.867789 8952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.844479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:46231 (local address 127.5.197.131:34205)
0807 19:55:08.851497 (+ 7018us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:08.851527 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:08.851861 (+ 334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:08.852516 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:08.852520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:08.853396 (+ 876us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:08.853910 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.853928 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.855551 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.855557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.857284 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.857304 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.858565 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.858572 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.858752 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.859469 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:08.859494 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:08.860860 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:08.864879 (+ 4019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.864885 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.864890 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.865426 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.865824 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:08.865829 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:08.865833 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:08.866001 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:08.866576 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:08.866581 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:08.866799 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 19:55:08.866942 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 19:55:08.867297 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6801,"thread_start_us":6609,"threads_started":1}
I20260807 19:55:08.867976 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:55:08 dist-test-slave-6bbx krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:55:08 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:08.923303 8814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.909556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.5.197.190:46231)
0807 19:55:08.909795 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.909802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.909938 (+ 136us) server_negotiation.cc:407] Connection header received
0807 19:55:08.910151 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.910155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.910235 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.910329 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:08.911777 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.912511 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.913763 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.914174 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.914288 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.918283 (+ 3995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:08.918288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:08.918291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:08.918329 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:08.920816 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.921425 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.921429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.921432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.921573 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:08.921922 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:08.921926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:08.921928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:08.922210 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:08.922464 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.922759 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.922978 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:55:08.927328 8293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:08.934430 8293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:08.958900 9000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.946870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52894 (local address 127.5.197.129:43379)
0807 19:55:08.949282 (+ 2412us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.949291 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.949319 (+ 28us) server_negotiation.cc:407] Connection header received
0807 19:55:08.949434 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.949441 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.949684 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.950623 (+ 939us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:08.950831 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.952526 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.955535 (+ 3009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.957693 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.957899 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.958122 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.958430 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.958602 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2252,"thread_start_us":2661,"threads_started":1}
I20260807 19:55:08.958920 8997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.946580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:43379 (local address 127.0.0.1:52894)
0807 19:55:08.947322 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:08.947379 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:08.947573 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:08.949943 (+ 2370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:08.949951 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:08.949987 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:08.950423 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.950435 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.952694 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.952701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.955258 (+ 2557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.955290 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.957929 (+ 2639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.957936 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.958159 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.958219 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 19:55:08.958372 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 19:55:08.958558 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":899,"threads_started":1}
I20260807 19:55:08.961412 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.946806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:46727 (local address 127.0.0.1:36770)
0807 19:55:08.949477 (+ 2671us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:08.949494 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:08.949699 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:08.950647 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:08.950652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:08.950678 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:08.952280 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.952294 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.954441 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.954447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.957638 (+ 3191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.957652 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.960635 (+ 2983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.960641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.960824 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.960853 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:55:08.960939 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 19:55:08.961065 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2535,"thread_start_us":10825,"threads_started":1}
I20260807 19:55:08.961524 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.947244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36770 (local address 127.5.197.131:46727)
0807 19:55:08.948875 (+ 1631us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.948883 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.949586 (+ 703us) server_negotiation.cc:407] Connection header received
0807 19:55:08.949899 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.949908 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.950140 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.950302 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:08.952516 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.954241 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.957855 (+ 3614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.960186 (+ 2331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.960302 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.960513 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.961048 (+ 535us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.961205 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1449,"thread_start_us":1612,"threads_started":1}
I20260807 19:55:08.962930 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 454cc6cb498c4a60ac6a3959fddea0f9 (DEFAULT_TABLE table=test-table [id=e2f0e2dbd64046759f90ad775eefe068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:08.964975 8999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.948617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38687 (local address 127.0.0.1:49658)
0807 19:55:08.957956 (+ 9339us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:08.957974 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:08.958112 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:08.958920 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:08.958924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:08.958948 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:08.959334 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.959346 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.961087 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.961092 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.962984 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:08.962996 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.964324 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.964331 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:08.964518 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.964546 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 19:55:08.964636 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 19:55:08.964754 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9193,"thread_start_us":710,"threads_started":1}
I20260807 19:55:08.965265 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454cc6cb498c4a60ac6a3959fddea0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:08.965636 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:08.949156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49658 (local address 127.5.197.130:38687)
0807 19:55:08.957584 (+ 8428us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:08.957593 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:08.958206 (+ 613us) server_negotiation.cc:407] Connection header received
0807 19:55:08.958299 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:08.958305 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:08.958534 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:08.958722 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:08.959547 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.960939 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.963128 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:08.964121 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:08.964256 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:08.964452 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:08.965251 (+ 799us) server_negotiation.cc:299] Negotiation successful
0807 19:55:08.965408 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8252,"thread_start_us":8134,"threads_started":1}
I20260807 19:55:08.965421 8875 tablet_service.cc:1467] Processing CreateTablet for tablet 454cc6cb498c4a60ac6a3959fddea0f9 (DEFAULT_TABLE table=test-table [id=e2f0e2dbd64046759f90ad775eefe068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:08.966862 8875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454cc6cb498c4a60ac6a3959fddea0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:08.968294 8675 tablet_service.cc:1467] Processing CreateTablet for tablet 454cc6cb498c4a60ac6a3959fddea0f9 (DEFAULT_TABLE table=test-table [id=e2f0e2dbd64046759f90ad775eefe068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:08.969398 8675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454cc6cb498c4a60ac6a3959fddea0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:08.979703 9005 tablet_bootstrap.cc:492] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Bootstrap starting.
I20260807 19:55:08.980736 9006 tablet_bootstrap.cc:492] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Bootstrap starting.
I20260807 19:55:08.982100 9007 tablet_bootstrap.cc:492] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Bootstrap starting.
I20260807 19:55:08.984253 9005 tablet_bootstrap.cc:654] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:08.984263 9006 tablet_bootstrap.cc:654] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:08.985038 9007 tablet_bootstrap.cc:654] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:08.985493 9006 log.cc:824] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:08.985493 9005 log.cc:824] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:08.986125 9007 log.cc:824] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:08.989933 9007 tablet_bootstrap.cc:492] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: No bootstrap required, opened a new log
I20260807 19:55:08.990185 9007 ts_tablet_manager.cc:1397] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20260807 19:55:08.990296 9005 tablet_bootstrap.cc:492] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: No bootstrap required, opened a new log
I20260807 19:55:08.990437 9006 tablet_bootstrap.cc:492] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: No bootstrap required, opened a new log
I20260807 19:55:08.990564 9005 ts_tablet_manager.cc:1397] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 19:55:08.990674 9006 ts_tablet_manager.cc:1397] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 19:55:08.997347 9007 raft_consensus.cc:348] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:08.997679 9007 raft_consensus.cc:374] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:08.997812 9007 raft_consensus.cc:729] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ffdb7b420454cb724518f234b3ca9, State: Initialized, Role: FOLLOWER
I20260807 19:55:08.998353 9007 consensus_queue.cc:260] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:08.999354 8974 heartbeater.cc:503] Master 127.5.197.190:46231 was elected leader, sending a full tablet report...
I20260807 19:55:09.000136 9007 ts_tablet_manager.cc:1428] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Time spent starting tablet: real 0.010s user 0.009s sys 0.002s
I20260807 19:55:09.000660 9005 raft_consensus.cc:348] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:09.000669 9006 raft_consensus.cc:348] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:09.001075 9006 raft_consensus.cc:374] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.001075 9005 raft_consensus.cc:374] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.001186 9006 raft_consensus.cc:729] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5de025f11643acab2bf7e709a90188, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.001179 9005 raft_consensus.cc:729] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.001765 9006 consensus_queue.cc:260] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:09.001757 9005 consensus_queue.cc:260] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:09.003382 8769 heartbeater.cc:503] Master 127.5.197.190:46231 was elected leader, sending a full tablet report...
I20260807 19:55:09.003444 9006 ts_tablet_manager.cc:1428] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Time spent starting tablet: real 0.013s user 0.005s sys 0.009s
I20260807 19:55:09.003866 9005 ts_tablet_manager.cc:1428] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
W20260807 19:55:09.007311 8587 tablet.cc:2369] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:55:09.056813 8771 tablet.cc:2369] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:09.077353 9016 raft_consensus.cc:482] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:09.077725 9016 raft_consensus.cc:504] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:09.079815 9016 leader_election.cc:288] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:09.088325 9000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.080305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:52903 (local address 127.5.197.129:43379)
0807 19:55:09.080529 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.080537 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.082023 (+ 1486us) server_negotiation.cc:407] Connection header received
0807 19:55:09.082307 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.082313 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.082391 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.082477 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:09.083120 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.084225 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.086592 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.087366 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.087516 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.087592 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.087963 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.088088 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 19:55:09.088644 9020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.080747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:43379 (local address 127.5.197.130:52903)
0807 19:55:09.081926 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:09.081943 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:09.082120 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:09.082512 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:09.082516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:09.082552 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:09.082994 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.083004 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.084370 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.084376 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.086428 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.086444 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.087601 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.087608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.087812 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.087837 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:55:09.087921 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 19:55:09.088041 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"thread_start_us":835,"threads_started":1}
I20260807 19:55:09.089869 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454cc6cb498c4a60ac6a3959fddea0f9" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188" is_pre_election: true
I20260807 19:55:09.090443 8509 raft_consensus.cc:2454] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:09.090670 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.080482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:39853 (local address 127.5.197.131:46727)
0807 19:55:09.080690 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.080696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.081636 (+ 940us) server_negotiation.cc:407] Connection header received
0807 19:55:09.081965 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.081971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.082074 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.082175 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:09.083058 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.084219 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.088769 (+ 4550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.089703 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.089887 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.089956 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.090307 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.090436 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:55:09.090746 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.080221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:46727 (local address 127.5.197.130:39853)
0807 19:55:09.081533 (+ 1312us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:09.081552 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:09.081776 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:09.082345 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:09.082350 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:09.082396 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:09.082877 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.082890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.086586 (+ 3696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.086590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.088592 (+ 2002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.088610 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.089928 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.089934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.090103 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.090137 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:55:09.090268 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 19:55:09.090392 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"spinlock_wait_cycles":23424,"thread_start_us":904,"threads_started":1}
I20260807 19:55:09.091178 8610 leader_election.cc:302] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, 6c5de025f11643acab2bf7e709a90188; no voters:
I20260807 19:55:09.091615 9016 raft_consensus.cc:2781] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:09.091775 9016 raft_consensus.cc:482] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:09.091853 9016 raft_consensus.cc:3037] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.091857 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454cc6cb498c4a60ac6a3959fddea0f9" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9" is_pre_election: true
I20260807 19:55:09.092244 8905 raft_consensus.cc:2454] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:09.095078 9016 raft_consensus.cc:504] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:09.095767 9016 leader_election.cc:288] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:09.096153 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454cc6cb498c4a60ac6a3959fddea0f9" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9"
I20260807 19:55:09.096170 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454cc6cb498c4a60ac6a3959fddea0f9" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188"
I20260807 19:55:09.096325 8905 raft_consensus.cc:3037] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.096354 8509 raft_consensus.cc:3037] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.098985 8905 raft_consensus.cc:2454] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:09.099363 8611 leader_election.cc:302] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:09.099488 8509 raft_consensus.cc:2454] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:09.099983 9016 raft_consensus.cc:2781] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:09.100584 9016 raft_consensus.cc:686] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 1 LEADER]: Becoming Leader. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Running, Role: LEADER
I20260807 19:55:09.101064 9016 consensus_queue.cc:237] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } }
I20260807 19:55:09.105381 8293 catalog_manager.cc:5495] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } health_report { overall_health: HEALTHY } } }
W20260807 19:55:09.110823 8978 tablet.cc:2369] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 19:55:09 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132507, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:09.175230 8814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.162073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.5.197.190:46231)
0807 19:55:09.162289 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.162295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.162855 (+ 560us) server_negotiation.cc:407] Connection header received
0807 19:55:09.162998 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.163001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.163064 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.163145 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:09.164277 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.165014 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.166200 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.166633 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.166724 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.169916 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:09.169921 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:09.169924 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:09.169953 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:09.172413 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:09.173236 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:09.173240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:09.173242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:09.173391 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:09.173762 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:09.173767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:09.173770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:09.174038 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:09.174166 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.174599 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.174909 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":87}
I20260807 19:55:09.175228 9031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.162161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:46231 (local address 127.0.0.1:35416)
0807 19:55:09.162761 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:09.162777 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:09.162903 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:09.163174 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:09.163177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:09.163903 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:09.164156 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.164165 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.165119 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.165122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.166075 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.166086 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.166793 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.166798 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.166911 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.167503 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:09.167525 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:09.169734 (+ 2209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:09.172554 (+ 2820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:09.172567 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:09.172575 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:09.173107 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:09.173493 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:09.173498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:09.173502 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:09.173662 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:09.174160 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:09.174167 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:09.174331 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 19:55:09.174494 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 19:55:09.174758 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":334,"threads_started":1}
I20260807 19:55:09.180306 8293 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:35416:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 19:55:09.181305 8293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:09.188004 8675 tablet_service.cc:1467] Processing CreateTablet for tablet 75a4b860c8fb4c64ba166a86a1b749d2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9ad99b5cfeb94141adeeb0c29ab40843]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:09.187919 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 75a4b860c8fb4c64ba166a86a1b749d2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9ad99b5cfeb94141adeeb0c29ab40843]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:09.188198 8875 tablet_service.cc:1467] Processing CreateTablet for tablet 75a4b860c8fb4c64ba166a86a1b749d2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9ad99b5cfeb94141adeeb0c29ab40843]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:09.188856 8675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a4b860c8fb4c64ba166a86a1b749d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:09.188906 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a4b860c8fb4c64ba166a86a1b749d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:09.188964 8875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a4b860c8fb4c64ba166a86a1b749d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:09.194386 9005 tablet_bootstrap.cc:492] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: Bootstrap starting.
I20260807 19:55:09.195960 9006 tablet_bootstrap.cc:492] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: Bootstrap starting.
I20260807 19:55:09.196123 9005 tablet_bootstrap.cc:654] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:09.197569 9006 tablet_bootstrap.cc:654] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:09.197697 9007 tablet_bootstrap.cc:492] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: Bootstrap starting.
I20260807 19:55:09.199247 9007 tablet_bootstrap.cc:654] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:09.199931 9006 tablet_bootstrap.cc:492] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: No bootstrap required, opened a new log
I20260807 19:55:09.200088 9006 ts_tablet_manager.cc:1397] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260807 19:55:09.200510 9005 tablet_bootstrap.cc:492] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: No bootstrap required, opened a new log
I20260807 19:55:09.200671 9005 ts_tablet_manager.cc:1397] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 19:55:09.200942 9006 raft_consensus.cc:348] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.201225 9006 raft_consensus.cc:374] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.201332 9006 raft_consensus.cc:729] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5de025f11643acab2bf7e709a90188, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.201579 9007 tablet_bootstrap.cc:492] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: No bootstrap required, opened a new log
I20260807 19:55:09.201527 9005 raft_consensus.cc:348] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.201583 9006 consensus_queue.cc:260] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.201710 9007 ts_tablet_manager.cc:1397] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 19:55:09.201771 9005 raft_consensus.cc:374] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.201867 9005 raft_consensus.cc:729] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.202176 9006 ts_tablet_manager.cc:1428] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 19:55:09.202103 9005 consensus_queue.cc:260] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.202431 9007 raft_consensus.cc:348] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.202682 9007 raft_consensus.cc:374] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.202723 9005 ts_tablet_manager.cc:1428] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 19:55:09.202593 9016 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.202765 9007 raft_consensus.cc:729] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ffdb7b420454cb724518f234b3ca9, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.202895 9016 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:09.202986 9007 consensus_queue.cc:260] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.203225 9018 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.203514 9007 ts_tablet_manager.cc:1428] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 19:55:09.203620 9018 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:09.203766 9014 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.204121 9014 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:09.313385 9016 raft_consensus.cc:482] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:09.313619 9016 raft_consensus.cc:504] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.314357 9016 leader_election.cc:288] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:09.315028 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a4b860c8fb4c64ba166a86a1b749d2" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9" is_pre_election: true
I20260807 19:55:09.315039 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a4b860c8fb4c64ba166a86a1b749d2" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188" is_pre_election: true
I20260807 19:55:09.315291 8905 raft_consensus.cc:2454] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:09.315306 8509 raft_consensus.cc:2454] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:09.315773 8611 leader_election.cc:302] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:09.316090 9016 raft_consensus.cc:2781] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:09.316195 9016 raft_consensus.cc:482] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:09.316362 9016 raft_consensus.cc:3037] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.318459 9016 raft_consensus.cc:504] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.319062 9016 leader_election.cc:288] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:09.319584 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a4b860c8fb4c64ba166a86a1b749d2" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188"
I20260807 19:55:09.319578 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a4b860c8fb4c64ba166a86a1b749d2" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9"
I20260807 19:55:09.319831 8509 raft_consensus.cc:3037] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.319854 8905 raft_consensus.cc:3037] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.321940 8905 raft_consensus.cc:2454] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:09.321949 8509 raft_consensus.cc:2454] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:09.322402 8610 leader_election.cc:302] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, 6c5de025f11643acab2bf7e709a90188, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:09.322734 9016 raft_consensus.cc:2781] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:09.322927 9016 raft_consensus.cc:686] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [term 1 LEADER]: Becoming Leader. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Running, Role: LEADER
I20260807 19:55:09.323197 9016 consensus_queue.cc:237] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.324996 9021 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: TxnStatusTablet state changed. Reason: New leader 295a54b990db4f49a59453b22f6d99a0. Latest consensus state: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.325385 9021 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:09.326138 9039 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 19:55:09.326417 9039 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 19:55:09.326586 8290 catalog_manager.cc:5495] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:09.361485 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.355884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49662 (local address 127.5.197.130:38687)
0807 19:55:09.356069 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.356074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.356093 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:55:09.356281 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.356288 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.356381 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.356503 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:09.356950 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.357736 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.359071 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.359537 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.359651 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.360204 (+ 553us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:09.360793 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:09.360932 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.361066 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.361163 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 19:55:09.361527 9031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.355539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38687 (local address 127.0.0.1:49662)
0807 19:55:09.355878 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:09.355901 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:09.356059 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:09.356554 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:09.356560 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:09.356574 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:09.356800 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.356813 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.357885 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.357890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.358903 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.358925 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.359731 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.359738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.359906 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.359975 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:09.360907 (+ 932us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:09.360935 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 19:55:09.361022 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 19:55:09.361207 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 19:55:09.370162 8905 raft_consensus.cc:1261] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:09.370191 8509 raft_consensus.cc:1261] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:09.371229 9021 consensus_queue.cc:1035] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:09.371698 9016 consensus_queue.cc:1035] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:09.379417 9014 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: TxnStatusTablet state changed. Reason: New leader 295a54b990db4f49a59453b22f6d99a0. Latest consensus state: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.379704 9014 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:09.383348 9042 mvcc.cc:205] Tried to move back new op lower bound from 7315998758368862208 to 7315998758190489600. Current Snapshot: MvccSnapshot[applied={T|T < 7315998758368862208}]
I20260807 19:55:09.392311 9014 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.392598 9014 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P c84ffdb7b420454cb724518f234b3ca9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:09.396903 9016 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.397265 9016 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:09.402015 9018 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: TxnStatusTablet state changed. Reason: New leader 295a54b990db4f49a59453b22f6d99a0. Latest consensus state: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.402388 9018 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:09.404404 9016 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.404743 9016 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P 295a54b990db4f49a59453b22f6d99a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:09.407811 9018 tablet_replica.cc:439] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } } }
I20260807 19:55:09.408064 9018 tablet_replica.cc:442] T 75a4b860c8fb4c64ba166a86a1b749d2 P 6c5de025f11643acab2bf7e709a90188: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:09.414741 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.408298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49670 (local address 127.5.197.130:38687)
0807 19:55:09.408479 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.408485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.408902 (+ 417us) server_negotiation.cc:407] Connection header received
0807 19:55:09.408972 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.408977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.409084 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.409170 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:09.409746 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.410886 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.412989 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.413420 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.413516 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.414020 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:09.414148 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:09.414222 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.414372 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.414437 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:55:09.432726 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.426922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:41217 (local address 127.5.197.130:38687)
0807 19:55:09.427142 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.427149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.427524 (+ 375us) server_negotiation.cc:407] Connection header received
0807 19:55:09.427736 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.427741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.427812 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.427909 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:09.428472 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.429325 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.430895 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.431356 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.431466 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.431994 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:09.432098 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:09.432188 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.432322 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.432395 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 19:55:09.432871 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.426807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38687 (local address 127.5.197.130:41217)
0807 19:55:09.427422 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:09.427437 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:09.427588 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:09.427973 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:09.427977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:09.427989 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:09.428326 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.428336 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.429446 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.429451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.430761 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.430775 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.431539 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.431544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.431702 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.431772 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:09.432195 (+ 423us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:09.432205 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 19:55:09.432280 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 19:55:09.432413 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":327,"threads_started":1}
I20260807 19:55:09.443266 8509 raft_consensus.cc:1261] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:09.443284 8905 raft_consensus.cc:1261] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:09.443986 9016 consensus_queue.cc:1035] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:09.444334 9021 consensus_queue.cc:1035] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:09.454226 9044 mvcc.cc:205] Tried to move back new op lower bound from 7315998758674567168 to 7315998757281435648. Current Snapshot: MvccSnapshot[applied={T|T < 7315998758674567168}]
I20260807 19:55:09.516021 8293 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:09.516359 8293 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:09.520352 8293 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Sending DeleteTablet for 3 replicas of tablet 454cc6cb498c4a60ac6a3959fddea0f9
I20260807 19:55:09.521581 8875 tablet_service.cc:1514] Processing DeleteTablet for tablet 454cc6cb498c4a60ac6a3959fddea0f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:09 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:36770
I20260807 19:55:09.521581 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet 454cc6cb498c4a60ac6a3959fddea0f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:09 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:52894
I20260807 19:55:09.521938 8674 tablet_service.cc:1514] Processing DeleteTablet for tablet 454cc6cb498c4a60ac6a3959fddea0f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:09 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260807 19:55:09.525072 8293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:09.526620 8293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:09.537007 9067 tablet_replica.cc:330] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: stopping tablet replica
I20260807 19:55:09.537586 9067 raft_consensus.cc:2229] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:09.537793 8485 tablet_service.cc:1467] Processing CreateTablet for tablet 02221d24a1f94d5b960a7fb157f3eb4f (DEFAULT_TABLE table=test-table [id=bee30b1d5d224c73aac1a6df41d7afac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:09.538090 9067 raft_consensus.cc:2258] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:09.538017 8874 tablet_service.cc:1467] Processing CreateTablet for tablet 02221d24a1f94d5b960a7fb157f3eb4f (DEFAULT_TABLE table=test-table [id=bee30b1d5d224c73aac1a6df41d7afac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:09.538398 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02221d24a1f94d5b960a7fb157f3eb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:09.538522 8874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02221d24a1f94d5b960a7fb157f3eb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:09.538782 8675 tablet_service.cc:1467] Processing CreateTablet for tablet 02221d24a1f94d5b960a7fb157f3eb4f (DEFAULT_TABLE table=test-table [id=bee30b1d5d224c73aac1a6df41d7afac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:09.539263 8675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02221d24a1f94d5b960a7fb157f3eb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:09.545060 9007 tablet_bootstrap.cc:492] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: Bootstrap starting.
I20260807 19:55:09.545778 9006 tablet_bootstrap.cc:492] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: Bootstrap starting.
I20260807 19:55:09.546754 9007 tablet_bootstrap.cc:654] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:09.547556 9006 tablet_bootstrap.cc:654] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:09.548818 9005 tablet_bootstrap.cc:492] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: Bootstrap starting.
I20260807 19:55:09.550575 9005 tablet_bootstrap.cc:654] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:09.555086 9068 tablet_replica.cc:330] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: stopping tablet replica
I20260807 19:55:09.555632 9068 raft_consensus.cc:2229] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:09.556099 9068 raft_consensus.cc:2258] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:09.559065 9007 tablet_bootstrap.cc:492] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: No bootstrap required, opened a new log
I20260807 19:55:09.559265 9007 ts_tablet_manager.cc:1397] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.004s
I20260807 19:55:09.559410 9005 tablet_bootstrap.cc:492] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: No bootstrap required, opened a new log
I20260807 19:55:09.559707 9005 ts_tablet_manager.cc:1397] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260807 19:55:09.560215 9007 raft_consensus.cc:348] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.560410 9006 tablet_bootstrap.cc:492] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: No bootstrap required, opened a new log
I20260807 19:55:09.560493 9007 raft_consensus.cc:374] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.560586 9006 ts_tablet_manager.cc:1397] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260807 19:55:09.560580 9007 raft_consensus.cc:729] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ffdb7b420454cb724518f234b3ca9, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.560904 9007 consensus_queue.cc:260] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.561318 9006 raft_consensus.cc:348] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.561568 9006 raft_consensus.cc:374] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.561647 9006 raft_consensus.cc:729] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5de025f11643acab2bf7e709a90188, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.561941 9006 consensus_queue.cc:260] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.562505 9007 ts_tablet_manager.cc:1428] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:09.562630 9006 ts_tablet_manager.cc:1428] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 19:55:09.563503 9069 tablet_replica.cc:330] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: stopping tablet replica
I20260807 19:55:09.564026 9069 raft_consensus.cc:2229] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:09.564798 9069 raft_consensus.cc:2258] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:09.565083 9068 ts_tablet_manager.cc:1905] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:09.567090 9069 ts_tablet_manager.cc:1905] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:09.569761 9005 raft_consensus.cc:348] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.570152 9005 raft_consensus.cc:374] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:09.570344 9005 raft_consensus.cc:729] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Initialized, Role: FOLLOWER
I20260807 19:55:09.570670 9067 ts_tablet_manager.cc:1905] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:09.570731 9005 consensus_queue.cc:260] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.571641 9005 ts_tablet_manager.cc:1428] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260807 19:55:09.575263 9069 ts_tablet_manager.cc:1918] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:09.575513 9069 log.cc:1196] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/454cc6cb498c4a60ac6a3959fddea0f9
I20260807 19:55:09.576156 9069 ts_tablet_manager.cc:1939] T 454cc6cb498c4a60ac6a3959fddea0f9 P 295a54b990db4f49a59453b22f6d99a0: Deleting consensus metadata
I20260807 19:55:09.578121 8274 catalog_manager.cc:4841] TS 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687): tablet 454cc6cb498c4a60ac6a3959fddea0f9 (table test-table [id=e2f0e2dbd64046759f90ad775eefe068]) successfully deleted
I20260807 19:55:09.580284 9068 ts_tablet_manager.cc:1918] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:09.580474 9068 log.cc:1196] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/454cc6cb498c4a60ac6a3959fddea0f9
I20260807 19:55:09.581010 9068 ts_tablet_manager.cc:1939] T 454cc6cb498c4a60ac6a3959fddea0f9 P 6c5de025f11643acab2bf7e709a90188: Deleting consensus metadata
I20260807 19:55:09.581625 9067 ts_tablet_manager.cc:1918] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:09.581810 9067 log.cc:1196] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/454cc6cb498c4a60ac6a3959fddea0f9
I20260807 19:55:09.582366 9067 ts_tablet_manager.cc:1939] T 454cc6cb498c4a60ac6a3959fddea0f9 P c84ffdb7b420454cb724518f234b3ca9: Deleting consensus metadata
I20260807 19:55:09.582893 8271 catalog_manager.cc:4841] TS 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379): tablet 454cc6cb498c4a60ac6a3959fddea0f9 (table test-table [id=e2f0e2dbd64046759f90ad775eefe068]) successfully deleted
I20260807 19:55:09.584272 8273 catalog_manager.cc:4841] TS c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727): tablet 454cc6cb498c4a60ac6a3959fddea0f9 (table test-table [id=e2f0e2dbd64046759f90ad775eefe068]) successfully deleted
I20260807 19:55:09.589517 9014 raft_consensus.cc:482] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:09.589718 9014 raft_consensus.cc:504] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.591368 9014 leader_election.cc:288] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687)
I20260807 19:55:09.594969 9064 raft_consensus.cc:482] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:09.595185 9064 raft_consensus.cc:504] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.595943 9064 leader_election.cc:288] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:09.596889 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02221d24a1f94d5b960a7fb157f3eb4f" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9" is_pre_election: true
I20260807 19:55:09.597164 8905 raft_consensus.cc:2454] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:09.597802 8611 leader_election.cc:302] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:09.598174 9064 raft_consensus.cc:2781] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:09.598301 9064 raft_consensus.cc:482] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:09.598397 9064 raft_consensus.cc:3037] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.601910 9064 raft_consensus.cc:504] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.603530 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02221d24a1f94d5b960a7fb157f3eb4f" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9"
I20260807 19:55:09.603814 8905 raft_consensus.cc:3037] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.607352 8905 raft_consensus.cc:2454] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:09.607909 8611 leader_election.cc:302] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:09.608286 9016 raft_consensus.cc:2781] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:09.608453 9016 raft_consensus.cc:686] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 1 LEADER]: Becoming Leader. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Running, Role: LEADER
I20260807 19:55:09.608767 9016 consensus_queue.cc:237] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:09.611546 9064 leader_election.cc:288] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:09.613677 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02221d24a1f94d5b960a7fb157f3eb4f" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188" is_pre_election: true
I20260807 19:55:09.613966 8509 raft_consensus.cc:2454] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:09.614564 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02221d24a1f94d5b960a7fb157f3eb4f" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188"
I20260807 19:55:09.614768 8509 raft_consensus.cc:3037] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:09.619993 8293 catalog_manager.cc:5495] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:09.623026 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.591564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:43379 (local address 127.5.197.131:54221)
0807 19:55:09.602658 (+ 11094us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:09.602683 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:09.602834 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:09.615319 (+ 12485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:09.615325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:09.615355 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:09.615685 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.615701 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.618100 (+ 2399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.618106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.620498 (+ 2392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.620520 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.622170 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.622178 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.622360 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.622399 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:55:09.622472 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 19:55:09.622616 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10951,"thread_start_us":11341,"threads_started":1}
I20260807 19:55:09.624306 9077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.592139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:54221 (local address 127.5.197.129:43379)
0807 19:55:09.613355 (+ 21216us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.613363 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.613387 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:55:09.613465 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.613470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.613553 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.616495 (+ 2942us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:09.616684 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.617932 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.620730 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.621949 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.623700 (+ 1751us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.623774 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.623831 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.623987 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21072,"thread_start_us":20951,"threads_started":1}
I20260807 19:55:09.624500 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.592066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:58843 (local address 127.5.197.130:38687)
0807 19:55:09.592271 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:09.592277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:09.614524 (+ 22247us) server_negotiation.cc:407] Connection header received
0807 19:55:09.614930 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:09.614935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:09.615019 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:09.615084 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:09.617896 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.619341 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.621887 (+ 2546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.623268 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.623426 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.623506 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:09.624091 (+ 585us) server_negotiation.cc:299] Negotiation successful
0807 19:55:09.624231 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:55:09.625298 9076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:09.591701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38687 (local address 127.5.197.131:58843)
0807 19:55:09.614410 (+ 22709us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:09.614432 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:09.614647 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:09.615877 (+ 1230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:09.615882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:09.615911 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:09.616290 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.616302 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.619567 (+ 3265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.619573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.621547 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:09.621565 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:09.623718 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:09.623726 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:09.623894 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:09.623928 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:55:09.624791 (+ 863us) client_negotiation.cc:240] Negotiation successful
0807 19:55:09.624930 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22578,"thread_start_us":22198,"threads_started":1}
I20260807 19:55:09.625204 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02221d24a1f94d5b960a7fb157f3eb4f" candidate_uuid: "c84ffdb7b420454cb724518f234b3ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188" is_pre_election: true
I20260807 19:55:09.625180 8509 raft_consensus.cc:2454] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:09.626449 8702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02221d24a1f94d5b960a7fb157f3eb4f" candidate_uuid: "c84ffdb7b420454cb724518f234b3ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295a54b990db4f49a59453b22f6d99a0" is_pre_election: true
I20260807 19:55:09.627504 8806 leader_election.cc:302] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c84ffdb7b420454cb724518f234b3ca9; no voters: 295a54b990db4f49a59453b22f6d99a0, 6c5de025f11643acab2bf7e709a90188
I20260807 19:55:09.627938 9014 raft_consensus.cc:2726] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 19:55:09.655783 8509 raft_consensus.cc:1261] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:09.655812 8905 raft_consensus.cc:1261] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:09.656423 9021 consensus_queue.cc:1035] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:09.656891 9021 consensus_queue.cc:1035] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:09.670133 9045 mvcc.cc:205] Tried to move back new op lower bound from 7315998759543832576 to 7315998759360307200. Current Snapshot: MvccSnapshot[applied={T|T < 7315998759543832576}]
W20260807 19:55:09.686959 9042 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 19:55:11.280087 8290 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:11.280387 8290 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:11.284789 8290 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Sending DeleteTablet for 3 replicas of tablet 02221d24a1f94d5b960a7fb157f3eb4f
I20260807 19:55:11.285609 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet 02221d24a1f94d5b960a7fb157f3eb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:11 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:52894
I20260807 19:55:11.285666 8674 tablet_service.cc:1514] Processing DeleteTablet for tablet 02221d24a1f94d5b960a7fb157f3eb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:11 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260807 19:55:11.285738 8875 tablet_service.cc:1514] Processing DeleteTablet for tablet 02221d24a1f94d5b960a7fb157f3eb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:11 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:36770
I20260807 19:55:11.286348 9113 tablet_replica.cc:330] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: stopping tablet replica
I20260807 19:55:11.286510 9114 tablet_replica.cc:330] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: stopping tablet replica
I20260807 19:55:11.286669 9113 raft_consensus.cc:2229] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:11.286700 9114 raft_consensus.cc:2229] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:11.286945 9114 raft_consensus.cc:2258] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:11.287530 9113 raft_consensus.cc:2258] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:11.288054 9114 ts_tablet_manager.cc:1905] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:11.288677 9113 ts_tablet_manager.cc:1905] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:11.294760 9114 ts_tablet_manager.cc:1918] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:55:11.294936 9114 log.cc:1196] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/02221d24a1f94d5b960a7fb157f3eb4f
I20260807 19:55:11.295331 9113 ts_tablet_manager.cc:1918] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:55:11.295382 9114 ts_tablet_manager.cc:1939] T 02221d24a1f94d5b960a7fb157f3eb4f P c84ffdb7b420454cb724518f234b3ca9: Deleting consensus metadata
I20260807 19:55:11.295562 9113 log.cc:1196] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/02221d24a1f94d5b960a7fb157f3eb4f
I20260807 19:55:11.296095 9113 ts_tablet_manager.cc:1939] T 02221d24a1f94d5b960a7fb157f3eb4f P 295a54b990db4f49a59453b22f6d99a0: Deleting consensus metadata
I20260807 19:55:11.296820 9112 tablet_replica.cc:330] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: stopping tablet replica
I20260807 19:55:11.296968 8273 catalog_manager.cc:4841] TS c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727): tablet 02221d24a1f94d5b960a7fb157f3eb4f (table test-table [id=bee30b1d5d224c73aac1a6df41d7afac]) successfully deleted
I20260807 19:55:11.297040 9112 raft_consensus.cc:2229] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:11.297318 9112 raft_consensus.cc:2258] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:11.297344 8274 catalog_manager.cc:4841] TS 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687): tablet 02221d24a1f94d5b960a7fb157f3eb4f (table test-table [id=bee30b1d5d224c73aac1a6df41d7afac]) successfully deleted
I20260807 19:55:11.298303 9112 ts_tablet_manager.cc:1905] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:11.304090 9112 ts_tablet_manager.cc:1918] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:55:11.304237 9112 log.cc:1196] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/02221d24a1f94d5b960a7fb157f3eb4f
I20260807 19:55:11.304610 9112 ts_tablet_manager.cc:1939] T 02221d24a1f94d5b960a7fb157f3eb4f P 6c5de025f11643acab2bf7e709a90188: Deleting consensus metadata
I20260807 19:55:11.305709 8271 catalog_manager.cc:4841] TS 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379): tablet 02221d24a1f94d5b960a7fb157f3eb4f (table test-table [id=bee30b1d5d224c73aac1a6df41d7afac]) successfully deleted
Aug 07 19:55:11 dist-test-slave-6bbx krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132511, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:55:11 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132511, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:11.346155 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:11.331376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35418 (local address 127.5.197.190:46231)
0807 19:55:11.332012 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:11.332017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:11.332094 (+ 77us) server_negotiation.cc:407] Connection header received
0807 19:55:11.332341 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:11.332346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:11.332413 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:11.332512 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:11.333940 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.334738 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.336196 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.336685 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.336831 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:11.340889 (+ 4058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:11.340895 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:11.340899 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:11.340939 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:11.343576 (+ 2637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:11.344411 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:11.344416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:11.344419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:11.344576 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:11.344910 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:11.344914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:11.344916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:11.345235 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:11.345427 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:11.345658 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 19:55:11.345879 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":300,"threads_started":1}
I20260807 19:55:11.349637 8290 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:11.350260 8290 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:11.357239 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 8703b900b1474d25a562d97bbb6612df (DEFAULT_TABLE table=test-table [id=dc8177cd3fda4e039943b0a9f9e8d2e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:11.357328 8674 tablet_service.cc:1467] Processing CreateTablet for tablet 8703b900b1474d25a562d97bbb6612df (DEFAULT_TABLE table=test-table [id=dc8177cd3fda4e039943b0a9f9e8d2e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:11.357570 8875 tablet_service.cc:1467] Processing CreateTablet for tablet 8703b900b1474d25a562d97bbb6612df (DEFAULT_TABLE table=test-table [id=dc8177cd3fda4e039943b0a9f9e8d2e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:11.357788 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8703b900b1474d25a562d97bbb6612df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:11.357813 8674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8703b900b1474d25a562d97bbb6612df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:11.357963 8875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8703b900b1474d25a562d97bbb6612df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:11.364504 9127 tablet_bootstrap.cc:492] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: Bootstrap starting.
I20260807 19:55:11.366092 9127 tablet_bootstrap.cc:654] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:11.372825 9128 tablet_bootstrap.cc:492] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: Bootstrap starting.
I20260807 19:55:11.373170 9129 tablet_bootstrap.cc:492] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: Bootstrap starting.
I20260807 19:55:11.374663 9128 tablet_bootstrap.cc:654] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:11.374876 9129 tablet_bootstrap.cc:654] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:11.375435 9127 tablet_bootstrap.cc:492] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: No bootstrap required, opened a new log
I20260807 19:55:11.375595 9127 ts_tablet_manager.cc:1397] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260807 19:55:11.377108 9127 raft_consensus.cc:348] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.377322 9127 raft_consensus.cc:374] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:11.377394 9128 tablet_bootstrap.cc:492] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: No bootstrap required, opened a new log
I20260807 19:55:11.377432 9127 raft_consensus.cc:729] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5de025f11643acab2bf7e709a90188, State: Initialized, Role: FOLLOWER
I20260807 19:55:11.377552 9128 ts_tablet_manager.cc:1397] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.003s
I20260807 19:55:11.377723 9127 consensus_queue.cc:260] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.378455 9129 tablet_bootstrap.cc:492] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: No bootstrap required, opened a new log
I20260807 19:55:11.378320 9128 raft_consensus.cc:348] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.378561 9128 raft_consensus.cc:374] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:11.378628 9129 ts_tablet_manager.cc:1397] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 19:55:11.378664 9128 raft_consensus.cc:729] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ffdb7b420454cb724518f234b3ca9, State: Initialized, Role: FOLLOWER
I20260807 19:55:11.379205 9128 consensus_queue.cc:260] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.379488 9129 raft_consensus.cc:348] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.379851 9129 raft_consensus.cc:374] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:11.379969 9129 raft_consensus.cc:729] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Initialized, Role: FOLLOWER
I20260807 19:55:11.380098 9128 ts_tablet_manager.cc:1428] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 19:55:11.380291 9136 raft_consensus.cc:482] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:11.380208 9129 consensus_queue.cc:260] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.380445 9136 raft_consensus.cc:504] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.381490 9129 ts_tablet_manager.cc:1428] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:11.382398 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8703b900b1474d25a562d97bbb6612df" candidate_uuid: "c84ffdb7b420454cb724518f234b3ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188" is_pre_election: true
I20260807 19:55:11.382465 8702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8703b900b1474d25a562d97bbb6612df" candidate_uuid: "c84ffdb7b420454cb724518f234b3ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295a54b990db4f49a59453b22f6d99a0" is_pre_election: true
I20260807 19:55:11.382696 8508 raft_consensus.cc:2454] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84ffdb7b420454cb724518f234b3ca9 in term 0.
I20260807 19:55:11.382771 8702 raft_consensus.cc:2454] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84ffdb7b420454cb724518f234b3ca9 in term 0.
I20260807 19:55:11.383213 8804 leader_election.cc:302] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5de025f11643acab2bf7e709a90188, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:11.383558 9137 raft_consensus.cc:2781] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:11.382130 9136 leader_election.cc:288] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687)
I20260807 19:55:11.383790 9137 raft_consensus.cc:482] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:11.383945 9137 raft_consensus.cc:3037] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:11.384645 9127 ts_tablet_manager.cc:1428] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260807 19:55:11.386924 9137 raft_consensus.cc:504] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.387537 9137 leader_election.cc:288] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687)
I20260807 19:55:11.387931 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8703b900b1474d25a562d97bbb6612df" candidate_uuid: "c84ffdb7b420454cb724518f234b3ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188"
I20260807 19:55:11.387987 8702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8703b900b1474d25a562d97bbb6612df" candidate_uuid: "c84ffdb7b420454cb724518f234b3ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295a54b990db4f49a59453b22f6d99a0"
I20260807 19:55:11.388151 8508 raft_consensus.cc:3037] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:11.388185 8702 raft_consensus.cc:3037] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:11.390235 8702 raft_consensus.cc:2454] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84ffdb7b420454cb724518f234b3ca9 in term 1.
I20260807 19:55:11.390237 8508 raft_consensus.cc:2454] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84ffdb7b420454cb724518f234b3ca9 in term 1.
I20260807 19:55:11.390679 8806 leader_election.cc:302] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:11.390998 9137 raft_consensus.cc:2781] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:11.391191 9137 raft_consensus.cc:686] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 1 LEADER]: Becoming Leader. State: Replica: c84ffdb7b420454cb724518f234b3ca9, State: Running, Role: LEADER
I20260807 19:55:11.391580 9137 consensus_queue.cc:237] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.394816 8293 catalog_manager.cc:5495] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131). New cstate: current_term: 1 leader_uuid: "c84ffdb7b420454cb724518f234b3ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } health_report { overall_health: HEALTHY } } }
I20260807 19:55:11.418848 9141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:11.413001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36784 (local address 127.5.197.131:46727)
0807 19:55:11.413634 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:11.413638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:11.413656 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:55:11.413741 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:11.413745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:11.413822 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:11.413979 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:11.414405 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.415153 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.416502 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.416959 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.417074 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:11.417539 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:11.418135 (+ 596us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:11.418273 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:11.418392 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 19:55:11.418473 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":311,"threads_started":1}
I20260807 19:55:11.435456 9148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:11.429967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:40227 (local address 127.5.197.130:38687)
0807 19:55:11.430559 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:11.430565 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:11.430596 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:55:11.430699 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:11.430704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:11.430778 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:11.430860 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:11.431381 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.432218 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.433558 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.434030 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.434139 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:11.434601 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:11.434715 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:11.434794 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:11.434923 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 19:55:11.435002 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":308,"threads_started":1}
I20260807 19:55:11.435503 9147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:11.429802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38687 (local address 127.5.197.131:40227)
0807 19:55:11.430419 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:11.430440 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:11.430579 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:11.430889 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:11.430894 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:11.430906 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:11.431225 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:11.431235 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.432362 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.432367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:11.433422 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:11.433434 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.434201 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.434209 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:11.434338 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:11.434396 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:11.434810 (+ 414us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:11.434823 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 19:55:11.434893 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 19:55:11.435054 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":259,"threads_started":1}
I20260807 19:55:11.443929 8508 raft_consensus.cc:1261] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Refusing update from remote peer c84ffdb7b420454cb724518f234b3ca9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:11.444620 9137 consensus_queue.cc:1035] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:11.444881 8702 raft_consensus.cc:1261] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Refusing update from remote peer c84ffdb7b420454cb724518f234b3ca9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:11.445549 9137 consensus_queue.cc:1035] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:11.474251 9141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:11.468649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:58765 (local address 127.5.197.131:46727)
0807 19:55:11.469072 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:11.469079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:11.469549 (+ 470us) server_negotiation.cc:407] Connection header received
0807 19:55:11.469710 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:11.469714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:11.469778 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:11.469848 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:11.470262 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.471008 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.472771 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.473258 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.473389 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:11.473727 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:11.473836 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:11.473903 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:11.473983 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 19:55:11.474046 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298}
I20260807 19:55:11.474397 9160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:11.468568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:46727 (local address 127.5.197.130:58765)
0807 19:55:11.469447 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:11.469467 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:11.469601 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:11.469866 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:11.469870 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:11.469880 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:11.470124 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:11.470132 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.471147 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.471153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:11.472626 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:11.472644 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.473430 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.473435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:11.473559 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:11.473599 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:11.473909 (+ 310us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:11.473916 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 19:55:11.473969 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 19:55:11.474074 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":303,"threads_started":1}
I20260807 19:55:11.502941 8293 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:11.503206 8293 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:11.506372 8293 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Sending DeleteTablet for 3 replicas of tablet 8703b900b1474d25a562d97bbb6612df
I20260807 19:55:11.507272 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet 8703b900b1474d25a562d97bbb6612df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:11 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:52894
I20260807 19:55:11.507314 8674 tablet_service.cc:1514] Processing DeleteTablet for tablet 8703b900b1474d25a562d97bbb6612df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:11 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260807 19:55:11.507380 8875 tablet_service.cc:1514] Processing DeleteTablet for tablet 8703b900b1474d25a562d97bbb6612df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:11 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:36770
I20260807 19:55:11.507601 9113 tablet_replica.cc:330] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: stopping tablet replica
I20260807 19:55:11.507692 9114 tablet_replica.cc:330] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: stopping tablet replica
I20260807 19:55:11.507833 9113 raft_consensus.cc:2229] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:11.507911 9114 raft_consensus.cc:2229] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:11.508045 9113 raft_consensus.cc:2258] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:11.508355 9112 tablet_replica.cc:330] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: stopping tablet replica
I20260807 19:55:11.508430 9114 raft_consensus.cc:2258] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:11.508565 9112 raft_consensus.cc:2229] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:11.508775 9112 raft_consensus.cc:2258] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:11.509869 9114 ts_tablet_manager.cc:1905] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:11.509956 9113 ts_tablet_manager.cc:1905] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:11.510321 8293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:11.510983 8293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:11.516602 9113 ts_tablet_manager.cc:1918] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:11.516777 9113 log.cc:1196] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/8703b900b1474d25a562d97bbb6612df
I20260807 19:55:11.516919 9112 ts_tablet_manager.cc:1905] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:11.517215 9113 ts_tablet_manager.cc:1939] T 8703b900b1474d25a562d97bbb6612df P 295a54b990db4f49a59453b22f6d99a0: Deleting consensus metadata
I20260807 19:55:11.519181 8875 tablet_service.cc:1467] Processing CreateTablet for tablet 1a46e7c532124bf596d99a784f34e7ce (DEFAULT_TABLE table=test-table [id=9ba7ec309b9c4ac1b776d150f739a197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:11.519184 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 1a46e7c532124bf596d99a784f34e7ce (DEFAULT_TABLE table=test-table [id=9ba7ec309b9c4ac1b776d150f739a197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:11.519646 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a46e7c532124bf596d99a784f34e7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:11.519655 8875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a46e7c532124bf596d99a784f34e7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:11.523487 9112 ts_tablet_manager.cc:1918] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:11.523653 9112 log.cc:1196] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/8703b900b1474d25a562d97bbb6612df
I20260807 19:55:11.524135 9112 ts_tablet_manager.cc:1939] T 8703b900b1474d25a562d97bbb6612df P 6c5de025f11643acab2bf7e709a90188: Deleting consensus metadata
I20260807 19:55:11.524096 8274 catalog_manager.cc:4841] TS 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687): tablet 8703b900b1474d25a562d97bbb6612df (table test-table [id=dc8177cd3fda4e039943b0a9f9e8d2e0]) successfully deleted
I20260807 19:55:11.524966 8674 tablet_service.cc:1467] Processing CreateTablet for tablet 1a46e7c532124bf596d99a784f34e7ce (DEFAULT_TABLE table=test-table [id=9ba7ec309b9c4ac1b776d150f739a197]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:11.525453 8674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a46e7c532124bf596d99a784f34e7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:11.527611 9127 tablet_bootstrap.cc:492] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: Bootstrap starting.
I20260807 19:55:11.527860 9128 tablet_bootstrap.cc:492] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: Bootstrap starting.
I20260807 19:55:11.529363 9127 tablet_bootstrap.cc:654] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:11.529451 9128 tablet_bootstrap.cc:654] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:11.531250 9114 ts_tablet_manager.cc:1918] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:11.531455 9114 log.cc:1196] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/8703b900b1474d25a562d97bbb6612df
I20260807 19:55:11.531967 9114 ts_tablet_manager.cc:1939] T 8703b900b1474d25a562d97bbb6612df P c84ffdb7b420454cb724518f234b3ca9: Deleting consensus metadata
I20260807 19:55:11.533178 8273 catalog_manager.cc:4841] TS c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727): tablet 8703b900b1474d25a562d97bbb6612df (table test-table [id=dc8177cd3fda4e039943b0a9f9e8d2e0]) successfully deleted
I20260807 19:55:11.537869 8271 catalog_manager.cc:4841] TS 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379): tablet 8703b900b1474d25a562d97bbb6612df (table test-table [id=dc8177cd3fda4e039943b0a9f9e8d2e0]) successfully deleted
I20260807 19:55:11.539754 9129 tablet_bootstrap.cc:492] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: Bootstrap starting.
I20260807 19:55:11.541603 9129 tablet_bootstrap.cc:654] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:11.541767 9128 tablet_bootstrap.cc:492] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: No bootstrap required, opened a new log
I20260807 19:55:11.541955 9127 tablet_bootstrap.cc:492] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: No bootstrap required, opened a new log
I20260807 19:55:11.541989 9128 ts_tablet_manager.cc:1397] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.008s
I20260807 19:55:11.542167 9127 ts_tablet_manager.cc:1397] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.006s
I20260807 19:55:11.542932 9128 raft_consensus.cc:348] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.542946 9127 raft_consensus.cc:348] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.543208 9127 raft_consensus.cc:374] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:11.543257 9128 raft_consensus.cc:374] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:11.543301 9127 raft_consensus.cc:729] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5de025f11643acab2bf7e709a90188, State: Initialized, Role: FOLLOWER
I20260807 19:55:11.543416 9128 raft_consensus.cc:729] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84ffdb7b420454cb724518f234b3ca9, State: Initialized, Role: FOLLOWER
I20260807 19:55:11.543601 9127 consensus_queue.cc:260] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.543722 9128 consensus_queue.cc:260] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.544489 9128 ts_tablet_manager.cc:1428] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 19:55:11.544854 9127 ts_tablet_manager.cc:1428] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:11.547019 9129 tablet_bootstrap.cc:492] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: No bootstrap required, opened a new log
I20260807 19:55:11.547207 9129 ts_tablet_manager.cc:1397] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260807 19:55:11.548123 9129 raft_consensus.cc:348] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.548406 9129 raft_consensus.cc:374] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:11.548488 9129 raft_consensus.cc:729] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Initialized, Role: FOLLOWER
I20260807 19:55:11.548775 9129 consensus_queue.cc:260] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.549355 9129 ts_tablet_manager.cc:1428] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 19:55:11.848731 9149 raft_consensus.cc:482] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:11.848992 9149 raft_consensus.cc:504] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.849892 9149 leader_election.cc:288] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:11.850477 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a46e7c532124bf596d99a784f34e7ce" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9" is_pre_election: true
I20260807 19:55:11.850483 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a46e7c532124bf596d99a784f34e7ce" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188" is_pre_election: true
I20260807 19:55:11.850746 8905 raft_consensus.cc:2454] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:11.850762 8508 raft_consensus.cc:2454] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 0.
I20260807 19:55:11.851312 8610 leader_election.cc:302] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, 6c5de025f11643acab2bf7e709a90188, c84ffdb7b420454cb724518f234b3ca9; no voters:
I20260807 19:55:11.851627 9149 raft_consensus.cc:2781] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:11.851784 9149 raft_consensus.cc:482] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:11.851886 9149 raft_consensus.cc:3037] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:11.854998 9149 raft_consensus.cc:504] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.855722 9149 leader_election.cc:288] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379), c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727)
I20260807 19:55:11.856194 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a46e7c532124bf596d99a784f34e7ce" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5de025f11643acab2bf7e709a90188"
I20260807 19:55:11.856367 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a46e7c532124bf596d99a784f34e7ce" candidate_uuid: "295a54b990db4f49a59453b22f6d99a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84ffdb7b420454cb724518f234b3ca9"
I20260807 19:55:11.856468 8508 raft_consensus.cc:3037] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:11.856594 8905 raft_consensus.cc:3037] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:11.859480 8508 raft_consensus.cc:2454] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:11.859653 8905 raft_consensus.cc:2454] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295a54b990db4f49a59453b22f6d99a0 in term 1.
I20260807 19:55:11.860250 8610 leader_election.cc:302] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295a54b990db4f49a59453b22f6d99a0, 6c5de025f11643acab2bf7e709a90188; no voters:
I20260807 19:55:11.860580 9149 raft_consensus.cc:2781] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:11.860746 9149 raft_consensus.cc:686] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 1 LEADER]: Becoming Leader. State: Replica: 295a54b990db4f49a59453b22f6d99a0, State: Running, Role: LEADER
I20260807 19:55:11.861025 9149 consensus_queue.cc:237] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } }
I20260807 19:55:11.863938 8293 catalog_manager.cc:5495] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "295a54b990db4f49a59453b22f6d99a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295a54b990db4f49a59453b22f6d99a0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:11.926540 9148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:11.921301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49676 (local address 127.5.197.130:38687)
0807 19:55:11.921468 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:11.921475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:11.921816 (+ 341us) server_negotiation.cc:407] Connection header received
0807 19:55:11.921995 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:11.922001 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:11.922073 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:11.922157 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:11.922731 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.923482 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.924910 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:11.925332 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:11.925448 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:11.925852 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:11.925962 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:11.926037 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:11.926185 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 19:55:11.926269 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 19:55:11.936522 8904 raft_consensus.cc:1261] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:11.936486 8508 raft_consensus.cc:1261] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Refusing update from remote peer 295a54b990db4f49a59453b22f6d99a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:11.937044 9149 consensus_queue.cc:1035] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5de025f11643acab2bf7e709a90188" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 43379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:11.937404 9106 consensus_queue.cc:1035] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84ffdb7b420454cb724518f234b3ca9" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 19:55:11.957723 9157 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 19:55:13.536304 8293 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:13.536602 8293 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:13.540977 8293 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 289614602d6343ee980b034b34a24f8c: Sending DeleteTablet for 3 replicas of tablet 1a46e7c532124bf596d99a784f34e7ce
I20260807 19:55:13.541924 8674 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a46e7c532124bf596d99a784f34e7ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:13 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260807 19:55:13.541939 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a46e7c532124bf596d99a784f34e7ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:13 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:52894
I20260807 19:55:13.542062 8875 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a46e7c532124bf596d99a784f34e7ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:13 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:36770
I20260807 19:55:13.544211 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 8394
I20260807 19:55:13.545236 9204 tablet_replica.cc:330] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: stopping tablet replica
I20260807 19:55:13.545512 9204 raft_consensus.cc:2229] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:13.545962 9204 raft_consensus.cc:2258] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:13.547696 9204 ts_tablet_manager.cc:1905] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:13.553218 9207 tablet_replica.cc:330] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: stopping tablet replica
I20260807 19:55:13.553628 9207 raft_consensus.cc:2229] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:13.553964 9207 raft_consensus.cc:2258] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:13.555169 9207 ts_tablet_manager.cc:1905] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:13.555701 9204 ts_tablet_manager.cc:1918] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:55:13.555924 9204 log.cc:1196] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/1a46e7c532124bf596d99a784f34e7ce
I20260807 19:55:13.556505 9204 ts_tablet_manager.cc:1939] T 1a46e7c532124bf596d99a784f34e7ce P 295a54b990db4f49a59453b22f6d99a0: Deleting consensus metadata
I20260807 19:55:13.557977 8274 catalog_manager.cc:4841] TS 295a54b990db4f49a59453b22f6d99a0 (127.5.197.130:38687): tablet 1a46e7c532124bf596d99a784f34e7ce (table test-table [id=9ba7ec309b9c4ac1b776d150f739a197]) successfully deleted
I20260807 19:55:13.560240 9206 tablet_replica.cc:330] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: stopping tablet replica
I20260807 19:55:13.560428 9206 raft_consensus.cc:2229] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:13.560653 9206 raft_consensus.cc:2258] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:13.561626 9206 ts_tablet_manager.cc:1905] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:13.562067 9207 ts_tablet_manager.cc:1918] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:55:13.562268 9207 log.cc:1196] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/1a46e7c532124bf596d99a784f34e7ce
I20260807 19:55:13.562741 9207 ts_tablet_manager.cc:1939] T 1a46e7c532124bf596d99a784f34e7ce P c84ffdb7b420454cb724518f234b3ca9: Deleting consensus metadata
I20260807 19:55:13.563992 8273 catalog_manager.cc:4841] TS c84ffdb7b420454cb724518f234b3ca9 (127.5.197.131:46727): tablet 1a46e7c532124bf596d99a784f34e7ce (table test-table [id=9ba7ec309b9c4ac1b776d150f739a197]) successfully deleted
I20260807 19:55:13.567543 9206 ts_tablet_manager.cc:1918] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:55:13.567695 9206 log.cc:1196] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/1a46e7c532124bf596d99a784f34e7ce
I20260807 19:55:13.568140 9206 ts_tablet_manager.cc:1939] T 1a46e7c532124bf596d99a784f34e7ce P 6c5de025f11643acab2bf7e709a90188: Deleting consensus metadata
I20260807 19:55:13.569113 8271 catalog_manager.cc:4841] TS 6c5de025f11643acab2bf7e709a90188 (127.5.197.129:43379): tablet 1a46e7c532124bf596d99a784f34e7ce (table test-table [id=9ba7ec309b9c4ac1b776d150f739a197]) successfully deleted
Aug 07 19:55:13 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132511, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:13.578841 9212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:13.545670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52898 (local address 127.5.197.129:43379)
0807 19:55:13.558967 (+ 13297us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:13.558975 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:13.559596 (+ 621us) server_negotiation.cc:407] Connection header received
0807 19:55:13.559811 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:13.559816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:13.559913 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:13.560077 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:13.562336 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:13.563260 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:13.564737 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:13.565479 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:13.565617 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:13.573280 (+ 7663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:13.573301 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:13.573320 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:13.573360 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:13.576245 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:13.576965 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:13.576973 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:13.576976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:13.577127 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:13.577527 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:13.577530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:13.577532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:13.577907 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:13.578146 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:13.578364 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 19:55:13.578545 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13106,"thread_start_us":12894,"threads_started":1}
W20260807 19:55:13.579535 8577 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52898
W20260807 19:55:13.580250 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 8394: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:13.580466 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 8394
I20260807 19:55:13.608125 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 8591
Aug 07 19:55:13 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132511, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:55:13.624074 9214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:13.609042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49682 (local address 127.5.197.130:38687)
0807 19:55:13.609565 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:13.609570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:13.609587 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:55:13.609648 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:13.609653 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:13.609725 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:13.609820 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:13.611058 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:13.612016 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:13.613334 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:13.613764 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:13.613863 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:13.618331 (+ 4468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:13.618349 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:13.618367 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:13.618405 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:13.621432 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:13.622131 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:13.622140 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:13.622151 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:13.622341 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:13.622641 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:13.622644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:13.622646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:13.623021 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:13.623288 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:13.623491 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 19:55:13.623728 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":261,"threads_started":1}
W20260807 19:55:13.624805 8763 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49682
W20260807 19:55:13.625456 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 8591: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:13.625595 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 8591
I20260807 19:55:13.660969 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 8774
Aug 07 19:55:13 dist-test-slave-6bbx krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132511, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:55:13.676903 9215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:13.661781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36800 (local address 127.5.197.131:46727)
0807 19:55:13.662381 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:13.662386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:13.662403 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:55:13.662463 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:13.662467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:13.662528 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:13.662633 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:13.664009 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:13.664813 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:13.666067 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:13.666498 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:13.666600 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:13.671384 (+ 4784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:13.671407 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:13.671431 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:13.671476 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:13.674225 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:13.674924 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:13.674932 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:13.674934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:13.675066 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:13.675354 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:13.675357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:13.675359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:13.675899 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:13.676135 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:13.676388 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 19:55:13.676567 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":274,"threads_started":1}
W20260807 19:55:13.677615 8965 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36800
W20260807 19:55:13.678243 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 8774: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:13.678439 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 8774
I20260807 19:55:13.709446 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 8249
I20260807 19:55:13.710741 8349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:13.830109 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 8249
2026-08-07T19:55:13Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8585 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:13 dist-test-slave-6bbx krb5kdc[9223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:13 dist-test-slave-6bbx krb5kdc[9223](info): set up 2 sockets
Aug 07 19:55:13 dist-test-slave-6bbx krb5kdc[9223](info): commencing operation
krb5kdc: starting...
W20260807 19:55:15.031309 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:15 dist-test-slave-6bbx krb5kdc[9223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:15.270814 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37545
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:15.657383 9243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:15.657702 9243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:15.657836 9243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:15.665346 9243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:15.665472 9243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:15.665555 9243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:15.665640 9243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:15.665705 9243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:15.676010 9243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:15.677479 9243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:15.678829 9243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:15.691794 9250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:15.691828 9249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:15.691859 9253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:15.692221 9243 server_base.cc:1034] running on GCE node
I20260807 19:55:15.693415 9243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:15.695029 9243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:15.696240 9243 hybrid_clock.cc:648] HybridClock initialized: now 1786132515696188 us; error 38 us; skew 500 ppm
I20260807 19:55:15.696601 9243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:15 dist-test-slave-6bbx krb5kdc[9223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132515, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:15.699957 9243 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:15.701594 9243 webserver.cc:460] Webserver started at http://127.5.197.190:37945/ using document root <none> and password file <none>
I20260807 19:55:15.702348 9243 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:15.702472 9243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:15.702803 9243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:15.706028 9243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "387c75e39d134cc89db9cfec166e2a47"
format_stamp: "Formatted at 2026-08-07 19:55:15 on dist-test-slave-6bbx"
server_key: "00176ae417be19b0c08052d373da4b0d"
server_key_iv: "485cf74e94cb05f480e3655df729e30f"
server_key_version: "encryptionkey@0"
I20260807 19:55:15.706881 9243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "387c75e39d134cc89db9cfec166e2a47"
format_stamp: "Formatted at 2026-08-07 19:55:15 on dist-test-slave-6bbx"
server_key: "00176ae417be19b0c08052d373da4b0d"
server_key_iv: "485cf74e94cb05f480e3655df729e30f"
server_key_version: "encryptionkey@0"
I20260807 19:55:15.712656 9243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:55:15.716410 9264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:15.717870 9243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:15.718058 9243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "387c75e39d134cc89db9cfec166e2a47"
format_stamp: "Formatted at 2026-08-07 19:55:15 on dist-test-slave-6bbx"
server_key: "00176ae417be19b0c08052d373da4b0d"
server_key_iv: "485cf74e94cb05f480e3655df729e30f"
server_key_version: "encryptionkey@0"
I20260807 19:55:15.718282 9243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:15.731890 9243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:15.736546 9243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:15.736828 9243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:15.755973 9243 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37545
I20260807 19:55:15.755993 9326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37545 every 8 connection(s)
I20260807 19:55:15.757469 9243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:15.761775 9328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:15.764393 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 9243
I20260807 19:55:15.764633 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:15.765419 5910 external_mini_cluster.cc:1428] Setting key 2a3d40ce3d94339aeaaa78f959f06127
I20260807 19:55:15.775483 9328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47: Bootstrap starting.
I20260807 19:55:15.779992 9328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47: Neither blocks nor log segments found. Creating new log.
Aug 07 19:55:15 dist-test-slave-6bbx krb5kdc[9223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:15.781291 9328 log.cc:824] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:15.785315 9328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47: No bootstrap required, opened a new log
I20260807 19:55:15.790174 9331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:15.767746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44612 (local address 127.5.197.190:37545)
0807 19:55:15.768693 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:15.768706 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:15.768752 (+ 46us) server_negotiation.cc:407] Connection header received
0807 19:55:15.770522 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:15.770548 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:15.770975 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:15.771333 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:15.773206 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:15.774644 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:15.776520 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:15.777251 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:15.777400 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:15.782331 (+ 4931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:15.782342 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:15.782364 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:15.782421 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:15.785682 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:15.786556 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:15.786564 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:15.786571 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:15.786750 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:15.787173 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:15.787176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:15.787177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:15.787840 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:15.788098 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:15.788595 (+ 497us) server_negotiation.cc:299] Negotiation successful
0807 19:55:15.789033 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":430,"threads_started":1}
I20260807 19:55:15.794126 9328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387c75e39d134cc89db9cfec166e2a47" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37545 } }
I20260807 19:55:15.794500 9328 raft_consensus.cc:374] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:15.794615 9328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387c75e39d134cc89db9cfec166e2a47, State: Initialized, Role: FOLLOWER
I20260807 19:55:15.795188 9328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387c75e39d134cc89db9cfec166e2a47" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37545 } }
I20260807 19:55:15.795418 9328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:15.795549 9328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:15.795791 9328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:15.818152 9328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387c75e39d134cc89db9cfec166e2a47" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37545 } }
I20260807 19:55:15.818915 9328 leader_election.cc:302] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 387c75e39d134cc89db9cfec166e2a47; no voters:
I20260807 19:55:15.819747 9328 leader_election.cc:288] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:15.819923 9335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:15.821280 9335 raft_consensus.cc:686] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [term 1 LEADER]: Becoming Leader. State: Replica: 387c75e39d134cc89db9cfec166e2a47, State: Running, Role: LEADER
I20260807 19:55:15.822113 9335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387c75e39d134cc89db9cfec166e2a47" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37545 } }
I20260807 19:55:15.823890 9328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:15.826785 9337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "387c75e39d134cc89db9cfec166e2a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387c75e39d134cc89db9cfec166e2a47" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37545 } } }
I20260807 19:55:15.827348 9337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:15.826740 9336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 387c75e39d134cc89db9cfec166e2a47. Latest consensus state: current_term: 1 leader_uuid: "387c75e39d134cc89db9cfec166e2a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387c75e39d134cc89db9cfec166e2a47" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37545 } } }
I20260807 19:55:15.827590 9336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:15.829803 9349 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:15.835602 9349 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:15.845167 9349 catalog_manager.cc:1347] Generated new cluster ID: bbefe099cff44d45b10ea9472be82d67
I20260807 19:55:15.845310 9349 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:15.881047 9349 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:15.883108 9349 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:15.892654 9349 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 387c75e39d134cc89db9cfec166e2a47: Generated new TSK 0
I20260807 19:55:15.893781 9349 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
W20260807 19:55:16.937937 5910 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.5.197.129: real 1.033s user 0.006s sys 0.013s
I20260807 19:55:16.938934 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37545
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:17.294804 9366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:17.295092 9366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:17.295233 9366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:17.302560 9366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:17.302680 9366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:17.302839 9366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:17.312685 9366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37545
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:17.314054 9366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:17.315492 9366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:17.328990 9378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:17.329424 9373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:17.329030 9372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:17.330065 9366 server_base.cc:1034] running on GCE node
I20260807 19:55:17.330641 9366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:17.331557 9366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:17.332782 9366 hybrid_clock.cc:648] HybridClock initialized: now 1786132517332744 us; error 57 us; skew 500 ppm
I20260807 19:55:17.333081 9366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:17 dist-test-slave-6bbx krb5kdc[9223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132517, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:17.336261 9366 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:55:17.337675 9366 webserver.cc:460] Webserver started at http://127.5.197.129:45439/ using document root <none> and password file <none>
I20260807 19:55:17.338369 9366 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:17.338490 9366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:17.338819 9366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:17.341766 9366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "608acf2ce4ba460e9552cd0ac7b193bd"
format_stamp: "Formatted at 2026-08-07 19:55:17 on dist-test-slave-6bbx"
server_key: "73747fb294bbbb88dfc94e4f45f53f47"
server_key_iv: "ff686119f9d06cd6e31efd78b7f6a639"
server_key_version: "encryptionkey@0"
I20260807 19:55:17.342643 9366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "608acf2ce4ba460e9552cd0ac7b193bd"
format_stamp: "Formatted at 2026-08-07 19:55:17 on dist-test-slave-6bbx"
server_key: "73747fb294bbbb88dfc94e4f45f53f47"
server_key_iv: "ff686119f9d06cd6e31efd78b7f6a639"
server_key_version: "encryptionkey@0"
I20260807 19:55:17.347759 9366 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 19:55:17.351089 9386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:17.352409 9366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:17.352555 9366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "608acf2ce4ba460e9552cd0ac7b193bd"
format_stamp: "Formatted at 2026-08-07 19:55:17 on dist-test-slave-6bbx"
server_key: "73747fb294bbbb88dfc94e4f45f53f47"
server_key_iv: "ff686119f9d06cd6e31efd78b7f6a639"
server_key_version: "encryptionkey@0"
I20260807 19:55:17.352747 9366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:17.389966 9366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:17.394183 9366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:17.394474 9366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:17.395463 9366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:17.396859 9366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:17.396940 9366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:17.397073 9366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:17.397128 9366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:17.428454 9366 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:37903
I20260807 19:55:17.428503 9549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:37903 every 8 connection(s)
I20260807 19:55:17.429701 9366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:17.433544 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 9366
I20260807 19:55:17.433743 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:17.434567 5910 external_mini_cluster.cc:1428] Setting key 595e5598be9191a2f5e364656fdf156d
Aug 07 19:55:17 dist-test-slave-6bbx krb5kdc[9223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132517, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:17.451769 9553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:17.432098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:34425 (local address 127.5.197.190:37545)
0807 19:55:17.432519 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:17.432523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:17.433648 (+ 1125us) server_negotiation.cc:407] Connection header received
0807 19:55:17.435891 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:17.435902 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:17.435992 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:17.436096 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:17.437968 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.438675 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.440777 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.441296 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.441418 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:17.445703 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:17.445708 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:17.445711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:17.445743 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:17.448659 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:17.449415 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:17.449420 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:17.449423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:17.449570 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:17.450015 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:17.450020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:17.450023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:17.450400 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:17.450534 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:17.451151 (+ 617us) server_negotiation.cc:299] Negotiation successful
0807 19:55:17.451350 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":207,"threads_started":1}
I20260807 19:55:17.452443 9554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:17.432669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37545 (local address 127.5.197.129:34425)
0807 19:55:17.433467 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:17.433520 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:17.435604 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:17.436341 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:17.436349 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:17.437048 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:17.437782 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:17.437805 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.438838 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.438879 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:17.440649 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:17.440666 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.441588 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.441625 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:17.441980 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:17.442770 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:17.442808 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:17.445479 (+ 2671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:17.448806 (+ 3327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:17.448812 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:17.448823 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:17.449272 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:17.449693 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:17.449697 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:17.449699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:17.449893 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:17.450507 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:17.450512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:17.450806 (+ 294us) client_negotiation.cc:769] Sending connection context
0807 19:55:17.451016 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 19:55:17.451365 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":288,"threads_started":1}
I20260807 19:55:17.453915 9551 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37545
I20260807 19:55:17.454178 9551 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:17.454903 9551 heartbeater.cc:511] Master 127.5.197.190:37545 requested a full tablet report, sending...
I20260807 19:55:17.457233 9284 ts_manager.cc:194] Registered new tserver with Master: 608acf2ce4ba460e9552cd0ac7b193bd (127.5.197.129:37903)
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
I20260807 19:55:17.458874 9284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:34425
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:55:17.484769 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37545
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:17.835125 9558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:17.835441 9558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:17.835566 9558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:17.842878 9558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:17.842995 9558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:17.843123 9558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:17.852874 9558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37545
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:17.854173 9558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:17.855474 9558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:17.868640 9564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:17.868687 9565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:17.868770 9568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:17.869668 9558 server_base.cc:1034] running on GCE node
I20260807 19:55:17.870276 9558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:17.871187 9558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:17.872392 9558 hybrid_clock.cc:648] HybridClock initialized: now 1786132517872335 us; error 44 us; skew 500 ppm
I20260807 19:55:17.872709 9558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:17 dist-test-slave-6bbx krb5kdc[9223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132517, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:17.876181 9558 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:55:17.877611 9558 webserver.cc:460] Webserver started at http://127.5.197.130:34745/ using document root <none> and password file <none>
I20260807 19:55:17.878326 9558 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:17.878448 9558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:17.878754 9558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:17.881744 9558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "804dcdd768e0483a8e45427d9325eaf3"
format_stamp: "Formatted at 2026-08-07 19:55:17 on dist-test-slave-6bbx"
server_key: "039c124819ea71684cae25ea2bd30536"
server_key_iv: "5b9755a2914bc38ca07e5d16fc652248"
server_key_version: "encryptionkey@0"
I20260807 19:55:17.882524 9558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "804dcdd768e0483a8e45427d9325eaf3"
format_stamp: "Formatted at 2026-08-07 19:55:17 on dist-test-slave-6bbx"
server_key: "039c124819ea71684cae25ea2bd30536"
server_key_iv: "5b9755a2914bc38ca07e5d16fc652248"
server_key_version: "encryptionkey@0"
I20260807 19:55:17.887720 9558 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 19:55:17.891160 9575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:17.892524 9558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 19:55:17.892681 9558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "804dcdd768e0483a8e45427d9325eaf3"
format_stamp: "Formatted at 2026-08-07 19:55:17 on dist-test-slave-6bbx"
server_key: "039c124819ea71684cae25ea2bd30536"
server_key_iv: "5b9755a2914bc38ca07e5d16fc652248"
server_key_version: "encryptionkey@0"
I20260807 19:55:17.892863 9558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:17.910096 9558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:17.913811 9558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:17.914070 9558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:17.914990 9558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:17.916399 9558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:17.916478 9558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:17.916600 9558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:17.916654 9558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:17.946892 9558 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:45871
I20260807 19:55:17.946933 9731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:45871 every 8 connection(s)
I20260807 19:55:17.948177 9558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:17.957988 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 9558
I20260807 19:55:17.958166 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:17.958712 5910 external_mini_cluster.cc:1428] Setting key 29b6386233c05b4266840fc001f92f1c
Aug 07 19:55:17 dist-test-slave-6bbx krb5kdc[9223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132517, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:17.968039 9553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:17.950647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:60661 (local address 127.5.197.190:37545)
0807 19:55:17.950852 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:17.950866 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:17.952148 (+ 1282us) server_negotiation.cc:407] Connection header received
0807 19:55:17.953978 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:17.953982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:17.954068 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:17.954155 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:17.955525 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.956300 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.957935 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.958522 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.958647 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:17.962205 (+ 3558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:17.962211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:17.962217 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:17.962256 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:17.965141 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:17.965797 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:17.965803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:17.965806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:17.965969 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:17.966326 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:17.966330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:17.966333 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:17.966652 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:17.966799 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:17.967509 (+ 710us) server_negotiation.cc:299] Negotiation successful
0807 19:55:17.967741 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:55:17.969007 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:17.951159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37545 (local address 127.5.197.130:60661)
0807 19:55:17.951985 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:17.952023 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:17.953715 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:17.954341 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:17.954348 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:17.954862 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:17.955393 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:17.955410 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.956450 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.956454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:17.957786 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:17.957799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:17.958734 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:17.958740 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:17.958961 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:17.959556 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:17.959583 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:17.961975 (+ 2392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:17.965273 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:17.965279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:17.965291 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:17.965676 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:17.966060 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:17.966063 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:17.966065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:17.966233 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:17.966805 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:17.966811 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:17.967135 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 19:55:17.967390 (+ 255us) client_negotiation.cc:240] Negotiation successful
0807 19:55:17.967874 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":350,"threads_started":1}
I20260807 19:55:17.970352 9736 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37545
I20260807 19:55:17.970647 9736 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:17.971343 9736 heartbeater.cc:511] Master 127.5.197.190:37545 requested a full tablet report, sending...
I20260807 19:55:17.972738 9284 ts_manager.cc:194] Registered new tserver with Master: 804dcdd768e0483a8e45427d9325eaf3 (127.5.197.130:45871)
I20260807 19:55:17.973526 9284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:60661
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:55:18.007988 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37545
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:18.341727 9742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:18.342018 9742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:18.342172 9742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:18.349299 9742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:18.349419 9742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:18.349577 9742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:18.359174 9742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37545
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:18.360426 9742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:18.361760 9742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:18.374320 9756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:18.374398 9751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:18.374411 9749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:18.375276 9742 server_base.cc:1034] running on GCE node
I20260807 19:55:18.375931 9742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:18.376801 9742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:18.378001 9742 hybrid_clock.cc:648] HybridClock initialized: now 1786132518377953 us; error 41 us; skew 500 ppm
I20260807 19:55:18.378293 9742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:18 dist-test-slave-6bbx krb5kdc[9223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132518, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:18.381521 9742 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:55:18.383090 9742 webserver.cc:460] Webserver started at http://127.5.197.131:39499/ using document root <none> and password file <none>
I20260807 19:55:18.383826 9742 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:18.383952 9742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:18.384261 9742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:18.387247 9742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "ceb810e0147a4e35b9bbe9d2d99122d5"
format_stamp: "Formatted at 2026-08-07 19:55:18 on dist-test-slave-6bbx"
server_key: "53616bf41a8fc2916b810e8d4a39f129"
server_key_iv: "d0ba9fde67c07bbb08b070562c9bc8c5"
server_key_version: "encryptionkey@0"
I20260807 19:55:18.388159 9742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "ceb810e0147a4e35b9bbe9d2d99122d5"
format_stamp: "Formatted at 2026-08-07 19:55:18 on dist-test-slave-6bbx"
server_key: "53616bf41a8fc2916b810e8d4a39f129"
server_key_iv: "d0ba9fde67c07bbb08b070562c9bc8c5"
server_key_version: "encryptionkey@0"
I20260807 19:55:18.393262 9742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:55:18.396680 9764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:18.398077 9742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:55:18.398217 9742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "ceb810e0147a4e35b9bbe9d2d99122d5"
format_stamp: "Formatted at 2026-08-07 19:55:18 on dist-test-slave-6bbx"
server_key: "53616bf41a8fc2916b810e8d4a39f129"
server_key_iv: "d0ba9fde67c07bbb08b070562c9bc8c5"
server_key_version: "encryptionkey@0"
I20260807 19:55:18.398378 9742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:18.421720 9742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:18.425943 9742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:18.426188 9742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:18.427103 9742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:18.428552 9742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:18.428633 9742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:18.428752 9742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:18.428805 9742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:18.461244 9742 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:41713
I20260807 19:55:18.461315 9919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:41713 every 8 connection(s)
I20260807 19:55:18.461650 9551 heartbeater.cc:503] Master 127.5.197.190:37545 was elected leader, sending a full tablet report...
I20260807 19:55:18.462661 9742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:18.469322 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 9742
I20260807 19:55:18.469566 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:18.470060 5910 external_mini_cluster.cc:1428] Setting key 794b41de30a5e8bb41ab24a76013db03
Aug 07 19:55:18 dist-test-slave-6bbx krb5kdc[9223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132518, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:18.482441 9553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:18.465283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:48789 (local address 127.5.197.190:37545)
0807 19:55:18.465444 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:18.465449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:18.466691 (+ 1242us) server_negotiation.cc:407] Connection header received
0807 19:55:18.468625 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:18.468631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:18.468747 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:18.468850 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:18.470619 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:18.471466 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:18.473370 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:18.473807 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:18.473903 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:18.477211 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:18.477216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:18.477219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:18.477250 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:18.479579 (+ 2329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:18.480343 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:18.480348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:18.480350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:18.480500 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:18.480866 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:18.480870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:18.480872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:18.481137 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:18.481269 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:18.481938 (+ 669us) server_negotiation.cc:299] Negotiation successful
0807 19:55:18.482154 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 19:55:18.483438 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:18.465728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37545 (local address 127.5.197.131:48789)
0807 19:55:18.466501 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:18.466551 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:18.468350 (+ 1799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:18.469114 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:18.469122 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:18.469825 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:18.470451 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:18.470470 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:18.471640 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:18.471646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:18.473239 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:18.473252 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:18.473975 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:18.473980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:18.474167 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:18.474789 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:18.474812 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:18.476996 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:18.479748 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:18.479755 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:18.479768 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:18.480185 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:18.480589 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:18.480592 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:18.480594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:18.480784 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:18.481250 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:18.481256 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:18.481582 (+ 326us) client_negotiation.cc:769] Sending connection context
0807 19:55:18.481821 (+ 239us) client_negotiation.cc:240] Negotiation successful
0807 19:55:18.482297 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":283,"threads_started":1}
I20260807 19:55:18.484855 9920 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37545
I20260807 19:55:18.485163 9920 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:18.485911 9920 heartbeater.cc:511] Master 127.5.197.190:37545 requested a full tablet report, sending...
I20260807 19:55:18.487323 9284 ts_manager.cc:194] Registered new tserver with Master: ceb810e0147a4e35b9bbe9d2d99122d5 (127.5.197.131:41713)
I20260807 19:55:18.488179 9284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:48789
I20260807 19:55:18.497695 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 19:55:18.534915 9553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:18.532647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45780 (local address 127.5.197.190:37545)
0807 19:55:18.532825 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:18.532830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:18.533266 (+ 436us) server_negotiation.cc:407] Connection header received
0807 19:55:18.533423 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:18.533427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:18.533497 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:18.533576 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:18.534722 (+ 1146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45780: BlockingRecv error: recv got EOF from 127.0.0.1:45780 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 19:55:18.538302 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9366
W20260807 19:55:18.541092 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9366: Not authorized: Client connection negotiation failed: client connection to 127.5.197.129:37903: server requires authentication, but client does not have Kerberos credentials available
I20260807 19:55:18.541275 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 9366
I20260807 19:55:18.564805 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9558
W20260807 19:55:18.567441 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9558: Not authorized: Client connection negotiation failed: client connection to 127.5.197.130:45871: server requires authentication, but client does not have Kerberos credentials available
I20260807 19:55:18.567591 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 9558
I20260807 19:55:18.594288 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9742
W20260807 19:55:18.597434 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9742: Not authorized: Client connection negotiation failed: client connection to 127.5.197.131:41713: server requires authentication, but client does not have Kerberos credentials available
I20260807 19:55:18.597621 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 9742
I20260807 19:55:18.624014 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9243
I20260807 19:55:18.625380 9319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:18.730919 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 9243
2026-08-07T19:55:18Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4891 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:18 dist-test-slave-6bbx krb5kdc[9943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:18 dist-test-slave-6bbx krb5kdc[9943](info): set up 2 sockets
Aug 07 19:55:18 dist-test-slave-6bbx krb5kdc[9943](info): commencing operation
krb5kdc: starting...
W20260807 19:55:19.909261 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:20 dist-test-slave-6bbx krb5kdc[9943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:20.127944 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45579
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:20.461647 9957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:20.461935 9957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:20.462071 9957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:20.469220 9957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:20.469327 9957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:20.469399 9957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:20.469472 9957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:20.469537 9957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:20.479614 9957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:20.480948 9957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:20.482336 9957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:20.493818 9966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:20.493911 9967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:20.493897 9969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:20.495007 9957 server_base.cc:1034] running on GCE node
I20260807 19:55:20.495842 9957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:20.497275 9957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:20.498474 9957 hybrid_clock.cc:648] HybridClock initialized: now 1786132520498434 us; error 34 us; skew 500 ppm
I20260807 19:55:20.498795 9957 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:20 dist-test-slave-6bbx krb5kdc[9943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132520, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:20.501863 9957 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:20.503378 9957 webserver.cc:460] Webserver started at http://127.5.197.190:38727/ using document root <none> and password file <none>
I20260807 19:55:20.504117 9957 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:20.504246 9957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:20.504554 9957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:20.507555 9957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "be84e4b41e144974bd1825cebac43606"
format_stamp: "Formatted at 2026-08-07 19:55:20 on dist-test-slave-6bbx"
server_key: "42c1490b3935da79f9eef18156c7d4e2"
server_key_iv: "9294bfc863b3eee31537af91c79145d6"
server_key_version: "encryptionkey@0"
I20260807 19:55:20.508415 9957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "be84e4b41e144974bd1825cebac43606"
format_stamp: "Formatted at 2026-08-07 19:55:20 on dist-test-slave-6bbx"
server_key: "42c1490b3935da79f9eef18156c7d4e2"
server_key_iv: "9294bfc863b3eee31537af91c79145d6"
server_key_version: "encryptionkey@0"
I20260807 19:55:20.513496 9957 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:20.516898 9976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:20.518219 9957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:20.518404 9957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "be84e4b41e144974bd1825cebac43606"
format_stamp: "Formatted at 2026-08-07 19:55:20 on dist-test-slave-6bbx"
server_key: "42c1490b3935da79f9eef18156c7d4e2"
server_key_iv: "9294bfc863b3eee31537af91c79145d6"
server_key_version: "encryptionkey@0"
I20260807 19:55:20.518585 9957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:20.543179 9957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:20.547109 9957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:20.547391 9957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:20.564881 9957 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:45579
I20260807 19:55:20.564911 10049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:45579 every 8 connection(s)
I20260807 19:55:20.566291 9957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:20.569761 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 9957
I20260807 19:55:20.569998 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:20.570587 10050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:20.570815 5910 external_mini_cluster.cc:1428] Setting key 68eb6321131ff053d3c4dbab7cedfec8
I20260807 19:55:20.585860 10050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606: Bootstrap starting.
Aug 07 19:55:20 dist-test-slave-6bbx krb5kdc[9943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:20.589258 10050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:20.590396 10050 log.cc:824] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:20.593629 10050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606: No bootstrap required, opened a new log
I20260807 19:55:20.596604 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:20.572620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45006 (local address 127.5.197.190:45579)
0807 19:55:20.576494 (+ 3874us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:20.576506 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:20.576548 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:55:20.578164 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:20.578187 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:20.578598 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:20.578975 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:20.580548 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:20.581810 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:20.583092 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:20.583870 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:20.584050 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:20.588090 (+ 4040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:20.588098 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:20.588111 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:20.588147 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:20.591398 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:20.592241 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:20.592247 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:20.592254 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:20.592447 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:20.592858 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:20.592861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:20.592863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:20.593428 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:20.593707 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:20.594743 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0807 19:55:20.595192 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3651,"thread_start_us":3428,"threads_started":1}
I20260807 19:55:20.600741 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:55:20.602874 10050 raft_consensus.cc:348] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be84e4b41e144974bd1825cebac43606" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45579 } }
I20260807 19:55:20.603225 10050 raft_consensus.cc:374] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:20.603329 10050 raft_consensus.cc:729] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be84e4b41e144974bd1825cebac43606, State: Initialized, Role: FOLLOWER
I20260807 19:55:20.603956 10050 consensus_queue.cc:260] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be84e4b41e144974bd1825cebac43606" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45579 } }
I20260807 19:55:20.604183 10050 raft_consensus.cc:388] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:20.604310 10050 raft_consensus.cc:482] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:20.604470 10050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:20.606599 10050 raft_consensus.cc:504] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be84e4b41e144974bd1825cebac43606" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45579 } }
I20260807 19:55:20.607092 10050 leader_election.cc:302] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be84e4b41e144974bd1825cebac43606; no voters:
I20260807 19:55:20.607751 10050 leader_election.cc:288] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:20.607894 10059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:20.608511 10059 raft_consensus.cc:686] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [term 1 LEADER]: Becoming Leader. State: Replica: be84e4b41e144974bd1825cebac43606, State: Running, Role: LEADER
I20260807 19:55:20.609131 10059 consensus_queue.cc:237] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be84e4b41e144974bd1825cebac43606" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45579 } }
I20260807 19:55:20.611186 10062 sys_catalog.cc:455] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be84e4b41e144974bd1825cebac43606. Latest consensus state: current_term: 1 leader_uuid: "be84e4b41e144974bd1825cebac43606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be84e4b41e144974bd1825cebac43606" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45579 } } }
I20260807 19:55:20.611588 10062 sys_catalog.cc:458] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:20.612094 10050 sys_catalog.cc:564] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:20.612025 10063 sys_catalog.cc:455] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be84e4b41e144974bd1825cebac43606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be84e4b41e144974bd1825cebac43606" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45579 } } }
I20260807 19:55:20.612365 10063 sys_catalog.cc:458] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:20.614655 10066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:20.620404 10066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:20.632679 10066 catalog_manager.cc:1347] Generated new cluster ID: f34e9dfd7a624a488fd3479e423cbc93
I20260807 19:55:20.632802 10066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:20.648813 10066 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:20.650029 10066 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:20.656535 10066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be84e4b41e144974bd1825cebac43606: Generated new TSK 0
I20260807 19:55:20.657604 10066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:55:20.665863 10057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:20.657056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45018 (local address 127.5.197.190:45579)
0807 19:55:20.657223 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:20.657229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:20.658080 (+ 851us) server_negotiation.cc:407] Connection header received
0807 19:55:20.658306 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:20.658312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:20.658397 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:20.658530 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:20.659801 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:20.660532 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:20.662438 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:20.662871 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:20.662959 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:20.664257 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:20.664262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:20.664265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:20.665113 (+ 848us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:20.665165 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:20.665198 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:20.665285 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:20.665462 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 19:55:20.665547 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 19:55:20.673225 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 9957
I20260807 19:55:20.674387 10043 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:20.764603 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 9957
2026-08-07T19:55:20Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2029 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:20 dist-test-slave-6bbx krb5kdc[10101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:20 dist-test-slave-6bbx krb5kdc[10101](info): set up 2 sockets
Aug 07 19:55:20 dist-test-slave-6bbx krb5kdc[10101](info): commencing operation
krb5kdc: starting...
W20260807 19:55:21.953863 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.003s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:22 dist-test-slave-6bbx krb5kdc[10101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:22.188026 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34509
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:38561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:34509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:22.511762 10118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:22.512040 10118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:22.512176 10118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:22.519078 10118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:22.519169 10118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:22.519239 10118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:22.519311 10118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:22.519368 10118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:22.528621 10118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:38561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:34509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:22.529803 10118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:22.531059 10118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:22.541985 10126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:22.541971 10128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:22.542011 10130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:22.542970 10118 server_base.cc:1034] running on GCE node
I20260807 19:55:22.543708 10118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:22.544947 10118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:22.546144 10118 hybrid_clock.cc:648] HybridClock initialized: now 1786132522546096 us; error 34 us; skew 500 ppm
I20260807 19:55:22.546451 10118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:22 dist-test-slave-6bbx krb5kdc[10101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132522, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:22.549423 10118 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:22.550757 10118 webserver.cc:460] Webserver started at http://127.5.197.190:38001/ using document root <none> and password file <none>
I20260807 19:55:22.551374 10118 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:22.551491 10118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:22.551818 10118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:22.554656 10118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "805e50c7e7bf4e4e89109463cd416a69"
format_stamp: "Formatted at 2026-08-07 19:55:22 on dist-test-slave-6bbx"
server_key: "66c73c921a4cc490edcd35ce6c1c1c56"
server_key_iv: "77671d97af5ea45dceb3b090e50fe292"
server_key_version: "encryptionkey@0"
I20260807 19:55:22.555375 10118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "805e50c7e7bf4e4e89109463cd416a69"
format_stamp: "Formatted at 2026-08-07 19:55:22 on dist-test-slave-6bbx"
server_key: "66c73c921a4cc490edcd35ce6c1c1c56"
server_key_iv: "77671d97af5ea45dceb3b090e50fe292"
server_key_version: "encryptionkey@0"
I20260807 19:55:22.560182 10118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:55:22.563421 10138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:22.564631 10118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:22.564779 10118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "805e50c7e7bf4e4e89109463cd416a69"
format_stamp: "Formatted at 2026-08-07 19:55:22 on dist-test-slave-6bbx"
server_key: "66c73c921a4cc490edcd35ce6c1c1c56"
server_key_iv: "77671d97af5ea45dceb3b090e50fe292"
server_key_version: "encryptionkey@0"
I20260807 19:55:22.564944 10118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:22.576733 10118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:22.580632 10118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:22.580881 10118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:22.597991 10118 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:34509
I20260807 19:55:22.598001 10214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:34509 every 8 connection(s)
I20260807 19:55:22.599272 10118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:22.602866 10215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:22.609346 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 10118
I20260807 19:55:22.609588 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:22.610368 5910 external_mini_cluster.cc:1428] Setting key 4ced16b83066eebac7e71fe44636367c
I20260807 19:55:22.613547 10215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69: Bootstrap starting.
I20260807 19:55:22.616891 10215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:22.617949 10215 log.cc:824] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:22.620518 10215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69: No bootstrap required, opened a new log
Aug 07 19:55:22 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:22.628006 10215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805e50c7e7bf4e4e89109463cd416a69" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34509 } }
I20260807 19:55:22.628367 10215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:22.628485 10215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e50c7e7bf4e4e89109463cd416a69, State: Initialized, Role: FOLLOWER
I20260807 19:55:22.629154 10215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805e50c7e7bf4e4e89109463cd416a69" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34509 } }
I20260807 19:55:22.629446 10215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:22.629591 10215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:22.629793 10215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:22.631611 10218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:22.612301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54204 (local address 127.5.197.190:34509)
0807 19:55:22.613018 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:22.613029 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:22.613068 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:55:22.614734 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:22.614756 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:22.615110 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:22.615424 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:22.617097 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:22.618406 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:22.619651 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:22.620319 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:22.620479 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:22.624221 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:22.624235 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:22.624248 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:22.624282 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:22.627181 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:22.627847 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:22.627854 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:22.627866 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:22.628028 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:22.628425 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:22.628430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:22.628434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:22.629103 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:22.629463 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:22.629816 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 19:55:22.630287 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":327,"threads_started":1}
I20260807 19:55:22.632650 10215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805e50c7e7bf4e4e89109463cd416a69" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34509 } }
I20260807 19:55:22.633112 10215 leader_election.cc:302] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 805e50c7e7bf4e4e89109463cd416a69; no voters:
I20260807 19:55:22.633668 10215 leader_election.cc:288] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:22.633819 10222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:22.634914 10222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [term 1 LEADER]: Becoming Leader. State: Replica: 805e50c7e7bf4e4e89109463cd416a69, State: Running, Role: LEADER
I20260807 19:55:22.635378 10222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805e50c7e7bf4e4e89109463cd416a69" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34509 } }
I20260807 19:55:22.635540 10215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:22.638806 10223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "805e50c7e7bf4e4e89109463cd416a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805e50c7e7bf4e4e89109463cd416a69" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34509 } } }
I20260807 19:55:22.638790 10224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 805e50c7e7bf4e4e89109463cd416a69. Latest consensus state: current_term: 1 leader_uuid: "805e50c7e7bf4e4e89109463cd416a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805e50c7e7bf4e4e89109463cd416a69" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34509 } } }
I20260807 19:55:22.639211 10224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:22.639211 10223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:22.640161 10232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:22.645177 10232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:22.655089 10232 catalog_manager.cc:1347] Generated new cluster ID: 45132b0d0493459c8a61ddfd01f2204f
I20260807 19:55:22.655216 10232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:22.682698 10232 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:22.683940 10232 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:22.689218 10232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 805e50c7e7bf4e4e89109463cd416a69: Generated new TSK 0
I20260807 19:55:22.689960 10232 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:55:22.750952 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34509
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:38561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:23.095187 10250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:23.095503 10250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:23.095630 10250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:23.102890 10250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:23.103003 10250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:23.103145 10250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:23.113117 10250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:38561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:23.114481 10250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:23.115836 10250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:23.128786 10255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:23.128978 10256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:23.129112 10258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:23.129879 10250 server_base.cc:1034] running on GCE node
I20260807 19:55:23.130471 10250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:23.131428 10250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:23.132627 10250 hybrid_clock.cc:648] HybridClock initialized: now 1786132523132560 us; error 59 us; skew 500 ppm
I20260807 19:55:23.132943 10250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:23 dist-test-slave-6bbx krb5kdc[10101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132523, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:23.136045 10250 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:55:23.137430 10250 webserver.cc:460] Webserver started at http://127.5.197.129:46413/ using document root <none> and password file <none>
I20260807 19:55:23.138141 10250 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:23.138247 10250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:23.138542 10250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:23.141510 10250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "f9eb32173aa64a37a1f9ecaa8eacdd7d"
format_stamp: "Formatted at 2026-08-07 19:55:23 on dist-test-slave-6bbx"
server_key: "57f71200ec117a33b8295fdc3b1bba71"
server_key_iv: "c0e79ccb4a2d3dd3cf33ce99e089e2db"
server_key_version: "encryptionkey@0"
I20260807 19:55:23.142321 10250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "f9eb32173aa64a37a1f9ecaa8eacdd7d"
format_stamp: "Formatted at 2026-08-07 19:55:23 on dist-test-slave-6bbx"
server_key: "57f71200ec117a33b8295fdc3b1bba71"
server_key_iv: "c0e79ccb4a2d3dd3cf33ce99e089e2db"
server_key_version: "encryptionkey@0"
I20260807 19:55:23.147596 10250 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:55:23.151207 10271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:23.152609 10250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:23.152778 10250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "f9eb32173aa64a37a1f9ecaa8eacdd7d"
format_stamp: "Formatted at 2026-08-07 19:55:23 on dist-test-slave-6bbx"
server_key: "57f71200ec117a33b8295fdc3b1bba71"
server_key_iv: "c0e79ccb4a2d3dd3cf33ce99e089e2db"
server_key_version: "encryptionkey@0"
I20260807 19:55:23.152977 10250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:23.169536 10250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:23.173588 10250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:23.173913 10250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:23.174940 10250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:23.176407 10250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:23.176483 10250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:23.176587 10250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:23.176635 10250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:23.208207 10250 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:46507
I20260807 19:55:23.208261 10423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:46507 every 8 connection(s)
I20260807 19:55:23.209486 10250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:23.214766 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 10250
I20260807 19:55:23.214965 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:23.215606 5910 external_mini_cluster.cc:1428] Setting key 7ddd382ac63b5019920375f61131905b
Aug 07 19:55:23 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132523, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:23.228999 10426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:23.211991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:48459 (local address 127.5.197.190:34509)
0807 19:55:23.212442 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:23.212447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:23.213336 (+ 889us) server_negotiation.cc:407] Connection header received
0807 19:55:23.215238 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:23.215244 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:23.215334 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:23.215439 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:23.217124 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.217996 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.219567 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.220039 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.220155 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:23.223553 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:23.223558 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:23.223561 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:23.223593 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:23.225997 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:23.226699 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:23.226705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:23.226708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:23.226829 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:23.227237 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:23.227243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:23.227246 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:23.227523 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:23.227658 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:23.228394 (+ 736us) server_negotiation.cc:299] Negotiation successful
0807 19:55:23.228627 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":226,"threads_started":1}
I20260807 19:55:23.229974 10427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:23.212456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34509 (local address 127.5.197.129:48459)
0807 19:55:23.213178 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:23.213217 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:23.214943 (+ 1726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:23.215725 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:23.215737 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:23.216342 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:23.216948 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:23.216966 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.218165 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.218169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:23.219407 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:23.219419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.220265 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.220272 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:23.220502 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:23.221135 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:23.221158 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:23.223333 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:23.226133 (+ 2800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:23.226142 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:23.226159 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:23.226585 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:23.226935 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:23.226940 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:23.226943 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:23.227131 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:23.227651 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:23.227658 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:23.228015 (+ 357us) client_negotiation.cc:769] Sending connection context
0807 19:55:23.228255 (+ 240us) client_negotiation.cc:240] Negotiation successful
0807 19:55:23.228812 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":281,"threads_started":1}
I20260807 19:55:23.231528 10424 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34509
I20260807 19:55:23.231902 10424 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:23.232856 10424 heartbeater.cc:511] Master 127.5.197.190:34509 requested a full tablet report, sending...
I20260807 19:55:23.235401 10165 ts_manager.cc:194] Registered new tserver with Master: f9eb32173aa64a37a1f9ecaa8eacdd7d (127.5.197.129:46507)
I20260807 19:55:23.237548 10165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:48459
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:55:23.267273 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34509
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:38561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:23.613276 10430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:23.613651 10430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:23.613812 10430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:23.623564 10430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:23.623708 10430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:23.623885 10430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:23.633934 10430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:38561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:23.635277 10430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:23.636724 10430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:23.649955 10438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:23.650002 10439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:23.650010 10441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:23.650869 10430 server_base.cc:1034] running on GCE node
I20260807 19:55:23.651491 10430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:23.652488 10430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:23.653687 10430 hybrid_clock.cc:648] HybridClock initialized: now 1786132523653627 us; error 50 us; skew 500 ppm
I20260807 19:55:23.654017 10430 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:23 dist-test-slave-6bbx krb5kdc[10101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132523, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:23.657248 10430 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:55:23.658581 10430 webserver.cc:460] Webserver started at http://127.5.197.130:45473/ using document root <none> and password file <none>
I20260807 19:55:23.659281 10430 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:23.659394 10430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:23.659658 10430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:23.662587 10430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "8e2b27ae53ce492b96e00424ee19267f"
format_stamp: "Formatted at 2026-08-07 19:55:23 on dist-test-slave-6bbx"
server_key: "ce6e3dd5081640c1dbbbbdfe6d0e37d1"
server_key_iv: "5e03c3f95fd47a83396c17fb121eaf7f"
server_key_version: "encryptionkey@0"
I20260807 19:55:23.663334 10430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "8e2b27ae53ce492b96e00424ee19267f"
format_stamp: "Formatted at 2026-08-07 19:55:23 on dist-test-slave-6bbx"
server_key: "ce6e3dd5081640c1dbbbbdfe6d0e37d1"
server_key_iv: "5e03c3f95fd47a83396c17fb121eaf7f"
server_key_version: "encryptionkey@0"
I20260807 19:55:23.668643 10430 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 19:55:23.672508 10450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:23.673875 10430 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:23.674033 10430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "8e2b27ae53ce492b96e00424ee19267f"
format_stamp: "Formatted at 2026-08-07 19:55:23 on dist-test-slave-6bbx"
server_key: "ce6e3dd5081640c1dbbbbdfe6d0e37d1"
server_key_iv: "5e03c3f95fd47a83396c17fb121eaf7f"
server_key_version: "encryptionkey@0"
I20260807 19:55:23.674232 10430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:23.689002 10430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:23.692950 10430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:23.693228 10430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:23.694193 10430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:23.695578 10430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:23.695652 10430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:23.695801 10430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:23.695852 10430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:23.726470 10430 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:39779
I20260807 19:55:23.726508 10598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:39779 every 8 connection(s)
I20260807 19:55:23.727807 10430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:23.730618 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 10430
I20260807 19:55:23.730834 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:23.731359 5910 external_mini_cluster.cc:1428] Setting key e44417ff223c6aebf19197d447241dfb
Aug 07 19:55:23 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132523, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:23.749042 10601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:23.730536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:46721 (local address 127.5.197.190:34509)
0807 19:55:23.731032 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:23.731038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:23.732139 (+ 1101us) server_negotiation.cc:407] Connection header received
0807 19:55:23.733990 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:23.733996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:23.734074 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:23.734181 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:23.735764 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.736699 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.738359 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.738903 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.739028 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:23.742772 (+ 3744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:23.742777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:23.742781 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:23.742816 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:23.745524 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:23.746437 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:23.746441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:23.746444 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:23.746595 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:23.747228 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:23.747232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:23.747234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:23.747519 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:23.747635 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:23.748589 (+ 954us) server_negotiation.cc:299] Negotiation successful
0807 19:55:23.748774 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":434,"threads_started":1}
I20260807 19:55:23.750528 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:23.731111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34509 (local address 127.5.197.130:46721)
0807 19:55:23.731975 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:23.732025 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:23.733699 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:23.734374 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:23.734383 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:23.734896 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:23.735567 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:23.735588 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.736893 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.736897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:23.738212 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:23.738225 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:23.739134 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:23.739142 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:23.739404 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:23.740075 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:23.740097 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:23.742500 (+ 2403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:23.745684 (+ 3184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:23.745694 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:23.745711 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:23.746289 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:23.746716 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:23.746722 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:23.746726 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:23.747085 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:23.747650 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:23.747657 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:23.748163 (+ 506us) client_negotiation.cc:769] Sending connection context
0807 19:55:23.748495 (+ 332us) client_negotiation.cc:240] Negotiation successful
0807 19:55:23.749075 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":329,"threads_started":1}
I20260807 19:55:23.752141 10599 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34509
I20260807 19:55:23.752507 10599 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:23.753276 10599 heartbeater.cc:511] Master 127.5.197.190:34509 requested a full tablet report, sending...
I20260807 19:55:23.754782 10165 ts_manager.cc:194] Registered new tserver with Master: 8e2b27ae53ce492b96e00424ee19267f (127.5.197.130:39779)
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
I20260807 19:55:23.755826 10165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:46721
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:55:23.784498 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34509
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:38561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:24.118604 10607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:24.118875 10607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:24.118970 10607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:24.126070 10607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:24.126181 10607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:24.126309 10607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:24.135926 10607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:38561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:24.137272 10607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:24.138638 10607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:24.151937 10614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:24.151846 10617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:24.151909 10615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:24.152686 10607 server_base.cc:1034] running on GCE node
I20260807 19:55:24.153321 10607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:24.154326 10607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:24.155539 10607 hybrid_clock.cc:648] HybridClock initialized: now 1786132524155487 us; error 43 us; skew 500 ppm
I20260807 19:55:24.155890 10607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132524, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:24.162174 10607 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:55:24.163760 10607 webserver.cc:460] Webserver started at http://127.5.197.131:38517/ using document root <none> and password file <none>
I20260807 19:55:24.164496 10607 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:24.164619 10607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:24.164927 10607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:24.168116 10607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "72822dba14544840a77b8161e0fe94e8"
format_stamp: "Formatted at 2026-08-07 19:55:24 on dist-test-slave-6bbx"
server_key: "b2596ea38ccf224a5a63d0a2daf06767"
server_key_iv: "f84afeacdea076270f052d704ec0535f"
server_key_version: "encryptionkey@0"
I20260807 19:55:24.168989 10607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "72822dba14544840a77b8161e0fe94e8"
format_stamp: "Formatted at 2026-08-07 19:55:24 on dist-test-slave-6bbx"
server_key: "b2596ea38ccf224a5a63d0a2daf06767"
server_key_iv: "f84afeacdea076270f052d704ec0535f"
server_key_version: "encryptionkey@0"
I20260807 19:55:24.174404 10607 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:24.178164 10627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:24.179809 10607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:24.179996 10607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "72822dba14544840a77b8161e0fe94e8"
format_stamp: "Formatted at 2026-08-07 19:55:24 on dist-test-slave-6bbx"
server_key: "b2596ea38ccf224a5a63d0a2daf06767"
server_key_iv: "f84afeacdea076270f052d704ec0535f"
server_key_version: "encryptionkey@0"
I20260807 19:55:24.180186 10607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:24.194773 10607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:24.198815 10607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:24.199092 10607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:24.200135 10607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:24.201510 10607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:24.201586 10607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:24.201699 10607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:24.201762 10607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:24.232151 10607 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:36097
I20260807 19:55:24.232204 10779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:36097 every 8 connection(s)
I20260807 19:55:24.233458 10607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:24.237208 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 10607
I20260807 19:55:24.237452 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:24.237926 5910 external_mini_cluster.cc:1428] Setting key 98734489a6e508607049fa88f0da4d4d
I20260807 19:55:24.240697 10424 heartbeater.cc:503] Master 127.5.197.190:34509 was elected leader, sending a full tablet report...
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132524, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:24.254725 10601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:24.235996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:40089 (local address 127.5.197.190:34509)
0807 19:55:24.236179 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:24.236183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:24.237614 (+ 1431us) server_negotiation.cc:407] Connection header received
0807 19:55:24.239855 (+ 2241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:24.239859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:24.239949 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:24.240060 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:24.242006 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.242839 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.244441 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.244827 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.244918 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:24.248696 (+ 3778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:24.248702 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:24.248705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:24.248740 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:24.251174 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.252128 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.252134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.252137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.252321 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.252846 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.252852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.252855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.253199 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:24.253395 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:24.254289 (+ 894us) server_negotiation.cc:299] Negotiation successful
0807 19:55:24.254491 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 19:55:24.255704 10783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:24.236558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34509 (local address 127.5.197.131:40089)
0807 19:55:24.237413 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:24.237486 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:24.239528 (+ 2042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:24.240337 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:24.240349 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:24.241123 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:24.241840 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:24.241859 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.242982 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.242986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:24.244317 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:24.244330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.245010 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.245017 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:24.245304 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:24.245963 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:24.245986 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:24.248492 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:24.251356 (+ 2864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:24.251364 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:24.251378 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:24.251942 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:24.252441 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:24.252446 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:24.252449 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:24.252677 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:24.253388 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:24.253397 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:24.253796 (+ 399us) client_negotiation.cc:769] Sending connection context
0807 19:55:24.254100 (+ 304us) client_negotiation.cc:240] Negotiation successful
0807 19:55:24.254571 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":332,"threads_started":1}
I20260807 19:55:24.257023 10780 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34509
I20260807 19:55:24.257313 10780 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:24.258049 10780 heartbeater.cc:511] Master 127.5.197.190:34509 requested a full tablet report, sending...
I20260807 19:55:24.259482 10165 ts_manager.cc:194] Registered new tserver with Master: 72822dba14544840a77b8161e0fe94e8 (127.5.197.131:36097)
I20260807 19:55:24.260316 10165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:40089
I20260807 19:55:24.266471 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132524, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132524, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:24.321578 10601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:24.307869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54212 (local address 127.5.197.190:34509)
0807 19:55:24.308104 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:24.308112 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:24.308531 (+ 419us) server_negotiation.cc:407] Connection header received
0807 19:55:24.308721 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:24.308726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:24.308811 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:24.308896 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:24.310257 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.311039 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.312358 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.312784 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.312896 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:24.316658 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:24.316663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:24.316666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:24.316706 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:24.319105 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.319806 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.319811 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.319813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.319954 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.320313 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.320317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.320319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.320654 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:24.320865 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:24.321066 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 19:55:24.321247 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 19:55:24.322105 10165 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54212
I20260807 19:55:24.323966 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10250
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132524, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:24.339694 10794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:24.325220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42382 (local address 127.5.197.129:46507)
0807 19:55:24.325896 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:24.325903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:24.325928 (+ 25us) server_negotiation.cc:407] Connection header received
0807 19:55:24.325986 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:24.325992 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:24.326198 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:24.326340 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:24.327517 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.328607 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.329803 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.330378 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.330493 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:24.334218 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:24.334230 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:24.334244 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:24.334277 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:24.337238 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.337890 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.337897 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.337899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.338032 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.338313 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.338316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.338318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.338664 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:24.338963 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:24.339089 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 19:55:24.339299 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":345,"threads_started":1}
W20260807 19:55:24.341003 10417 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42382
W20260807 19:55:24.342093 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10250: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:24.342283 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 10250
I20260807 19:55:24.365259 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10430
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132524, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:55:24.380909 10796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:24.366126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33144 (local address 127.5.197.130:39779)
0807 19:55:24.366635 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:24.366642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:24.366670 (+ 28us) server_negotiation.cc:407] Connection header received
0807 19:55:24.366733 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:24.366740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:24.366965 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:24.367089 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:24.368371 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.369422 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.370660 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.371208 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.371304 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:24.375417 (+ 4113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:24.375430 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:24.375444 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:24.375479 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:24.378170 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.378842 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.378851 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.378855 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.378993 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.379377 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.379379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.379381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.379767 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:24.380029 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:24.380287 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 19:55:24.380505 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":240,"threads_started":1}
W20260807 19:55:24.382339 10592 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33144
W20260807 19:55:24.383428 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10430: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:24.383611 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 10430
I20260807 19:55:24.409818 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10607
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132524, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:55:24.425843 10797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:24.410903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.5.197.131:36097)
0807 19:55:24.411567 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:24.411574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:24.411605 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:55:24.411690 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:24.411699 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:24.411942 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:24.412073 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:24.413385 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.414497 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.415653 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:24.416355 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:24.416455 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:24.420644 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:24.420656 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:24.420671 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:24.420705 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:24.423303 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.424080 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.424087 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.424089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.424211 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:24.424491 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:24.424494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:24.424496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:24.424835 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:24.425054 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:24.425354 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 19:55:24.425568 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":331,"threads_started":1}
W20260807 19:55:24.427178 10772 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33308
W20260807 19:55:24.428383 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10607: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:55:24.428540 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 10607
I20260807 19:55:24.452687 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10118
I20260807 19:55:24.453778 10209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:24.557703 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 10118
2026-08-07T19:55:24Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3793 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10801](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10801](info): set up 2 sockets
Aug 07 19:55:24 dist-test-slave-6bbx krb5kdc[10801](info): commencing operation
krb5kdc: starting...
W20260807 19:55:25.724745 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:25 dist-test-slave-6bbx krb5kdc[10801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:25.957382 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:41805
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:41805
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:26.283017 10817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:26.283313 10817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:26.283450 10817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:26.290588 10817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:26.290681 10817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:26.290753 10817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:26.290827 10817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:26.290884 10817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:26.300421 10817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:41805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:41805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:26.301637 10817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:26.302892 10817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:26.314055 10826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:26.314023 10827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:26.314078 10830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:26.314834 10817 server_base.cc:1034] running on GCE node
I20260807 19:55:26.315543 10817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:26.316869 10817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:26.318070 10817 hybrid_clock.cc:648] HybridClock initialized: now 1786132526318022 us; error 38 us; skew 500 ppm
I20260807 19:55:26.318387 10817 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:26 dist-test-slave-6bbx krb5kdc[10801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132526, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:26.321327 10817 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:26.322693 10817 webserver.cc:460] Webserver started at http://127.5.197.190:45437/ using document root <none> and password file <none>
I20260807 19:55:26.323323 10817 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:26.323449 10817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:26.323781 10817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:26.326658 10817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "f2d61139cb8c42249da6120550f973ed"
format_stamp: "Formatted at 2026-08-07 19:55:26 on dist-test-slave-6bbx"
server_key: "e0bdc26af290f2d8cefa073adb736f26"
server_key_iv: "04bf36891c1808eef7d250ff3de1b39e"
server_key_version: "encryptionkey@0"
I20260807 19:55:26.327396 10817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "f2d61139cb8c42249da6120550f973ed"
format_stamp: "Formatted at 2026-08-07 19:55:26 on dist-test-slave-6bbx"
server_key: "e0bdc26af290f2d8cefa073adb736f26"
server_key_iv: "04bf36891c1808eef7d250ff3de1b39e"
server_key_version: "encryptionkey@0"
I20260807 19:55:26.332106 10817 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:55:26.335237 10842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:26.336410 10817 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 19:55:26.336571 10817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "f2d61139cb8c42249da6120550f973ed"
format_stamp: "Formatted at 2026-08-07 19:55:26 on dist-test-slave-6bbx"
server_key: "e0bdc26af290f2d8cefa073adb736f26"
server_key_iv: "04bf36891c1808eef7d250ff3de1b39e"
server_key_version: "encryptionkey@0"
I20260807 19:55:26.336740 10817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:26.353220 10817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:26.356659 10817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:26.356911 10817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:26.374039 10817 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:41805
I20260807 19:55:26.374069 10914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:41805 every 8 connection(s)
I20260807 19:55:26.375279 10817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:26.377664 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 10817
I20260807 19:55:26.377887 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:26.378697 5910 external_mini_cluster.cc:1428] Setting key ca97e840d8bad8f2e4d02d10f159450c
I20260807 19:55:26.379303 10916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:26.393441 10916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed: Bootstrap starting.
Aug 07 19:55:26 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:26.396720 10916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:26.397742 10916 log.cc:824] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:26.400473 10916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed: No bootstrap required, opened a new log
I20260807 19:55:26.401575 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:26.380701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52352 (local address 127.5.197.190:41805)
0807 19:55:26.381443 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:26.381454 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:26.381496 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:55:26.383896 (+ 2400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:26.383920 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:26.384304 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:26.384648 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:26.386519 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:26.387831 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:26.389536 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:26.390200 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:26.390337 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:26.394676 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:26.394687 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:26.394699 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:26.394736 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:26.397706 (+ 2970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:26.398370 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:26.398376 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:26.398382 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:26.398589 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:26.398945 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:26.398950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:26.398954 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:26.399460 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:26.399755 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:26.400250 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 19:55:26.400669 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":323,"threads_started":1}
I20260807 19:55:26.408665 10916 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2d61139cb8c42249da6120550f973ed" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 41805 } }
I20260807 19:55:26.408988 10916 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:26.409080 10916 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2d61139cb8c42249da6120550f973ed, State: Initialized, Role: FOLLOWER
I20260807 19:55:26.409578 10916 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2d61139cb8c42249da6120550f973ed" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 41805 } }
I20260807 19:55:26.409787 10916 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:26.409911 10916 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:26.410056 10916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:26.412110 10916 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2d61139cb8c42249da6120550f973ed" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 41805 } }
I20260807 19:55:26.412556 10916 leader_election.cc:302] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2d61139cb8c42249da6120550f973ed; no voters:
I20260807 19:55:26.413126 10916 leader_election.cc:288] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:26.413214 10923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:26.414059 10923 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [term 1 LEADER]: Becoming Leader. State: Replica: f2d61139cb8c42249da6120550f973ed, State: Running, Role: LEADER
I20260807 19:55:26.414534 10923 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2d61139cb8c42249da6120550f973ed" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 41805 } }
I20260807 19:55:26.415220 10916 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:26.417339 10926 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2d61139cb8c42249da6120550f973ed. Latest consensus state: current_term: 1 leader_uuid: "f2d61139cb8c42249da6120550f973ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2d61139cb8c42249da6120550f973ed" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 41805 } } }
I20260807 19:55:26.417315 10924 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2d61139cb8c42249da6120550f973ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2d61139cb8c42249da6120550f973ed" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 41805 } } }
I20260807 19:55:26.417743 10926 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:26.417788 10924 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:26.419135 10932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:26.424304 10932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:26.433724 10932 catalog_manager.cc:1347] Generated new cluster ID: d5912bdcdbb24b4ea8033e5e756185a3
I20260807 19:55:26.433817 10932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:26.451903 10932 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:26.453328 10932 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:26.461827 10932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2d61139cb8c42249da6120550f973ed: Generated new TSK 0
I20260807 19:55:26.462564 10932 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:55:26.513536 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:41805
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:26.851392 10948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:26.851706 10948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:26.851853 10948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:26.859119 10948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:26.859243 10948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:26.859407 10948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:26.869522 10948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:41805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:26.870883 10948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:26.872262 10948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:26.885910 10958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:26.885995 10956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:26.885931 10955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:26.887166 10948 server_base.cc:1034] running on GCE node
I20260807 19:55:26.887851 10948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:26.888870 10948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:26.890093 10948 hybrid_clock.cc:648] HybridClock initialized: now 1786132526890041 us; error 35 us; skew 500 ppm
I20260807 19:55:26.890420 10948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:26 dist-test-slave-6bbx krb5kdc[10801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132526, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:26.893862 10948 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:55:26.895426 10948 webserver.cc:460] Webserver started at http://127.5.197.129:34501/ using document root <none> and password file <none>
I20260807 19:55:26.896219 10948 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:26.896349 10948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:26.896669 10948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:26.900214 10948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "c8ecba865f47406494fca16a60e67b09"
format_stamp: "Formatted at 2026-08-07 19:55:26 on dist-test-slave-6bbx"
server_key: "b39cc5aa4e44ba251ca6f30b1e3e816b"
server_key_iv: "3aa8bace2ef5cc397facb953fa0c2da1"
server_key_version: "encryptionkey@0"
I20260807 19:55:26.901115 10948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "c8ecba865f47406494fca16a60e67b09"
format_stamp: "Formatted at 2026-08-07 19:55:26 on dist-test-slave-6bbx"
server_key: "b39cc5aa4e44ba251ca6f30b1e3e816b"
server_key_iv: "3aa8bace2ef5cc397facb953fa0c2da1"
server_key_version: "encryptionkey@0"
I20260807 19:55:26.906636 10948 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:26.910404 10970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:26.911794 10948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:26.911976 10948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "c8ecba865f47406494fca16a60e67b09"
format_stamp: "Formatted at 2026-08-07 19:55:26 on dist-test-slave-6bbx"
server_key: "b39cc5aa4e44ba251ca6f30b1e3e816b"
server_key_iv: "3aa8bace2ef5cc397facb953fa0c2da1"
server_key_version: "encryptionkey@0"
I20260807 19:55:26.912195 10948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:26.924222 10948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:26.928617 10948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:26.928941 10948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:26.929978 10948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:26.931411 10948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:26.931495 10948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:26.931795 10948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:26.931870 10948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:26.964108 10948 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:44545
I20260807 19:55:26.964141 11128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:44545 every 8 connection(s)
I20260807 19:55:26.965446 10948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:26.975610 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 10948
I20260807 19:55:26.975849 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:26.976588 5910 external_mini_cluster.cc:1428] Setting key 99b6ef80646e900f368cd9213414ab41
Aug 07 19:55:26 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132526, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:26.985952 11133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:26.967947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:40659 (local address 127.5.197.190:41805)
0807 19:55:26.968389 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:26.968393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:26.969347 (+ 954us) server_negotiation.cc:407] Connection header received
0807 19:55:26.971517 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:26.971523 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:26.971607 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:26.971737 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:26.973245 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:26.973970 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:26.975760 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:26.976217 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:26.976328 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:26.980224 (+ 3896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:26.980231 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:26.980235 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:26.980271 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:26.982659 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:26.983411 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:26.983417 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:26.983420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:26.983570 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:26.984112 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:26.984116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:26.984118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:26.984386 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:26.984498 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:26.985429 (+ 931us) server_negotiation.cc:299] Negotiation successful
0807 19:55:26.985639 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":217,"threads_started":1}
I20260807 19:55:26.987188 11134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:26.968455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:41805 (local address 127.5.197.129:40659)
0807 19:55:26.969184 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:26.969222 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:26.971205 (+ 1983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:26.972000 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:26.972009 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:26.972520 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:26.973078 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:26.973095 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:26.974129 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:26.974133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:26.975568 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:26.975585 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:26.976468 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:26.976476 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:26.976769 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:26.977505 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:26.977528 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:26.980007 (+ 2479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:26.982800 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:26.982810 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:26.982829 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:26.983265 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:26.983717 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:26.983723 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:26.983726 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:26.983992 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:26.984508 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:26.984516 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:26.984958 (+ 442us) client_negotiation.cc:769] Sending connection context
0807 19:55:26.985272 (+ 314us) client_negotiation.cc:240] Negotiation successful
0807 19:55:26.985842 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":266,"threads_started":1}
I20260807 19:55:26.988790 11129 heartbeater.cc:347] Connected to a master server at 127.5.197.190:41805
I20260807 19:55:26.989107 11129 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:26.989836 11129 heartbeater.cc:511] Master 127.5.197.190:41805 requested a full tablet report, sending...
I20260807 19:55:26.992295 10864 ts_manager.cc:194] Registered new tserver with Master: c8ecba865f47406494fca16a60e67b09 (127.5.197.129:44545)
I20260807 19:55:26.994298 10864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:40659
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:55:27.031232 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:41805
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:27.371878 11137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:27.372152 11137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:27.372295 11137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:27.379438 11137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:27.379554 11137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:27.379735 11137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:27.389844 11137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:41805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:27.391244 11137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:27.392627 11137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:27.405943 11143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:27.406025 11148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:27.405993 11144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:27.406756 11137 server_base.cc:1034] running on GCE node
I20260807 19:55:27.407397 11137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:27.408550 11137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:27.409758 11137 hybrid_clock.cc:648] HybridClock initialized: now 1786132527409702 us; error 45 us; skew 500 ppm
I20260807 19:55:27.410096 11137 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:27 dist-test-slave-6bbx krb5kdc[10801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132527, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:27.413326 11137 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:55:27.414816 11137 webserver.cc:460] Webserver started at http://127.5.197.130:34411/ using document root <none> and password file <none>
I20260807 19:55:27.415557 11137 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:27.415699 11137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:27.416050 11137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:27.419026 11137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "f371e878ba584e98b48dc115995eadd6"
format_stamp: "Formatted at 2026-08-07 19:55:27 on dist-test-slave-6bbx"
server_key: "04a86fbd85731ffa680faa8b596ec49b"
server_key_iv: "b83c8a6fc15a01b5526a0eff4bbb01ad"
server_key_version: "encryptionkey@0"
I20260807 19:55:27.419866 11137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "f371e878ba584e98b48dc115995eadd6"
format_stamp: "Formatted at 2026-08-07 19:55:27 on dist-test-slave-6bbx"
server_key: "04a86fbd85731ffa680faa8b596ec49b"
server_key_iv: "b83c8a6fc15a01b5526a0eff4bbb01ad"
server_key_version: "encryptionkey@0"
I20260807 19:55:27.425208 11137 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 19:55:27.428869 11158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:27.430311 11137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 19:55:27.430496 11137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "f371e878ba584e98b48dc115995eadd6"
format_stamp: "Formatted at 2026-08-07 19:55:27 on dist-test-slave-6bbx"
server_key: "04a86fbd85731ffa680faa8b596ec49b"
server_key_iv: "b83c8a6fc15a01b5526a0eff4bbb01ad"
server_key_version: "encryptionkey@0"
I20260807 19:55:27.430719 11137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:27.452061 11137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:27.456741 11137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:27.457032 11137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:27.458125 11137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:27.459563 11137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:27.459656 11137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:27.459808 11137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:27.459867 11137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:27.493484 11137 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:37965
I20260807 19:55:27.493534 11312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:37965 every 8 connection(s)
I20260807 19:55:27.494877 11137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:27.505115 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 11137
I20260807 19:55:27.505304 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:27.505751 5910 external_mini_cluster.cc:1428] Setting key 2e824597af5935d0422580a17344eeb1
Aug 07 19:55:27 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132527, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:27.515836 11315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:27.497569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:41483 (local address 127.5.197.190:41805)
0807 19:55:27.498005 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:27.498010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:27.498976 (+ 966us) server_negotiation.cc:407] Connection header received
0807 19:55:27.501015 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:27.501021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:27.501108 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:27.501208 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:27.502909 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:27.503632 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:27.505242 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:27.505737 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:27.505856 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:27.509508 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:27.509514 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:27.509517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:27.509552 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:27.512557 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:27.513385 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:27.513391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:27.513394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:27.513558 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:27.513993 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:27.513997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:27.514000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:27.514347 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:27.514489 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:27.515206 (+ 717us) server_negotiation.cc:299] Negotiation successful
0807 19:55:27.515452 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":218,"threads_started":1}
I20260807 19:55:27.517112 11316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:27.498033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:41805 (local address 127.5.197.130:41483)
0807 19:55:27.498803 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:27.498845 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:27.500689 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:27.501483 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:27.501496 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:27.502111 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:27.502711 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:27.502739 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:27.503824 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:27.503828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:27.505081 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:27.505095 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:27.505982 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:27.505990 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:27.506227 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:27.506937 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:27.506967 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:27.509269 (+ 2302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:27.512737 (+ 3468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:27.512746 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:27.512773 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:27.513252 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:27.513660 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:27.513663 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:27.513665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:27.513889 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:27.514464 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:27.514470 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:27.514838 (+ 368us) client_negotiation.cc:769] Sending connection context
0807 19:55:27.515087 (+ 249us) client_negotiation.cc:240] Negotiation successful
0807 19:55:27.515583 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":284,"threads_started":1}
I20260807 19:55:27.518635 11313 heartbeater.cc:347] Connected to a master server at 127.5.197.190:41805
I20260807 19:55:27.518977 11313 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:27.519917 11313 heartbeater.cc:511] Master 127.5.197.190:41805 requested a full tablet report, sending...
I20260807 19:55:27.521610 10864 ts_manager.cc:194] Registered new tserver with Master: f371e878ba584e98b48dc115995eadd6 (127.5.197.130:37965)
I20260807 19:55:27.522467 10864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:41483
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:55:27.562551 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:41805
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:27.919782 11320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:27.920152 11320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:27.920368 11320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:27.927966 11320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:27.928093 11320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:27.928256 11320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:27.938261 11320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:41805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:27.939688 11320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:27.941144 11320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:27.954351 11326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:27.954403 11327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:27.954541 11331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:27.955246 11320 server_base.cc:1034] running on GCE node
I20260807 19:55:27.955942 11320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:27.956918 11320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:27.958129 11320 hybrid_clock.cc:648] HybridClock initialized: now 1786132527958075 us; error 47 us; skew 500 ppm
I20260807 19:55:27.958458 11320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:27 dist-test-slave-6bbx krb5kdc[10801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132527, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:27.961694 11320 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:55:27.963210 11320 webserver.cc:460] Webserver started at http://127.5.197.131:35201/ using document root <none> and password file <none>
I20260807 19:55:27.963953 11320 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:27.964069 11320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:27.964386 11320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:27.967260 11320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "8a2248783fe447db88937091092feade"
format_stamp: "Formatted at 2026-08-07 19:55:27 on dist-test-slave-6bbx"
server_key: "efdbbe33ccfe14048d78457cedeeca70"
server_key_iv: "bcefe66698fb71a295ee8765c1deb99c"
server_key_version: "encryptionkey@0"
I20260807 19:55:27.968215 11320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "8a2248783fe447db88937091092feade"
format_stamp: "Formatted at 2026-08-07 19:55:27 on dist-test-slave-6bbx"
server_key: "efdbbe33ccfe14048d78457cedeeca70"
server_key_iv: "bcefe66698fb71a295ee8765c1deb99c"
server_key_version: "encryptionkey@0"
I20260807 19:55:27.973678 11320 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:55:27.977579 11338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:27.978986 11320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:55:27.979146 11320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "8a2248783fe447db88937091092feade"
format_stamp: "Formatted at 2026-08-07 19:55:27 on dist-test-slave-6bbx"
server_key: "efdbbe33ccfe14048d78457cedeeca70"
server_key_iv: "bcefe66698fb71a295ee8765c1deb99c"
server_key_version: "encryptionkey@0"
I20260807 19:55:27.979347 11320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:27.997591 11129 heartbeater.cc:503] Master 127.5.197.190:41805 was elected leader, sending a full tablet report...
I20260807 19:55:27.997822 11320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:28.002351 11320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:28.002645 11320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:28.003649 11320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:28.005059 11320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:28.005137 11320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:28.005265 11320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:28.005318 11320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:28.037884 11320 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:34441
I20260807 19:55:28.037931 11491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:34441 every 8 connection(s)
I20260807 19:55:28.039175 11320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:28.041503 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 11320
I20260807 19:55:28.041659 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:28.042205 5910 external_mini_cluster.cc:1428] Setting key c5f19419e6d43e2ea7526f56c7c4e05a
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132527, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:28.060804 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:28.042056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:32897 (local address 127.5.197.190:41805)
0807 19:55:28.042747 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:28.042755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:28.044327 (+ 1572us) server_negotiation.cc:407] Connection header received
0807 19:55:28.046158 (+ 1831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:28.046164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:28.046255 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:28.046353 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:28.048024 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.048816 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.050416 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.050835 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.050949 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:28.054594 (+ 3645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:28.054600 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:28.054603 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:28.054639 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:28.057524 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.058304 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.058308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.058311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.058440 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.058890 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.058894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.058896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.059182 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:28.059332 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:28.060163 (+ 831us) server_negotiation.cc:299] Negotiation successful
0807 19:55:28.060403 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":426,"threads_started":1}
I20260807 19:55:28.061789 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:28.042860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:41805 (local address 127.5.197.131:32897)
0807 19:55:28.043718 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:28.043772 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:28.045892 (+ 2120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:28.046623 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:28.046632 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:28.047187 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:28.047854 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:28.047877 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.048980 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.048984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:28.050269 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:28.050283 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.051077 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.051084 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:28.051323 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:28.052036 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:28.052066 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:28.054353 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:28.057681 (+ 3328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:28.057692 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:28.057709 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:28.058170 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:28.058553 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:28.058558 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:28.058562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:28.058770 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:28.059323 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:28.059330 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:28.059746 (+ 416us) client_negotiation.cc:769] Sending connection context
0807 19:55:28.060038 (+ 292us) client_negotiation.cc:240] Negotiation successful
0807 19:55:28.060632 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":327,"threads_started":1}
I20260807 19:55:28.063128 11492 heartbeater.cc:347] Connected to a master server at 127.5.197.190:41805
I20260807 19:55:28.063422 11492 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:28.064198 11492 heartbeater.cc:511] Master 127.5.197.190:41805 requested a full tablet report, sending...
I20260807 19:55:28.065668 10864 ts_manager.cc:194] Registered new tserver with Master: 8a2248783fe447db88937091092feade (127.5.197.131:34441)
I20260807 19:55:28.066450 10864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:32897
I20260807 19:55:28.070537 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[10801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:28.130808 11502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:28.115001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56194 (local address 127.5.197.129:44545)
0807 19:55:28.115644 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:28.115655 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:28.115744 (+ 89us) server_negotiation.cc:407] Connection header received
0807 19:55:28.115836 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:28.115843 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:28.116087 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:28.116241 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:28.117654 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.118681 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.120064 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.120659 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.120818 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:28.124899 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:28.124914 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:28.124930 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:28.124968 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:28.127888 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.128613 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.128620 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.128623 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.128764 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.129146 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.129150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.129152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.129534 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:28.129833 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:28.130168 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 19:55:28.130456 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":275,"threads_started":1}
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:28.149896 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:28.135641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48166 (local address 127.5.197.190:41805)
0807 19:55:28.135906 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:28.135912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:28.136084 (+ 172us) server_negotiation.cc:407] Connection header received
0807 19:55:28.136334 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:28.136340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:28.136416 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:28.136499 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:28.137809 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.138551 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.139863 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.140511 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.140624 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:28.144622 (+ 3998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:28.144628 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:28.144632 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:28.144671 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:28.147037 (+ 2366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.147781 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.147786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.147788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.147933 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.148363 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.148368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.148370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.148751 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:28.149007 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:28.149331 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 19:55:28.149569 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
W20260807 19:55:28.150549 10864 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48166
I20260807 19:55:28.151648 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10948
I20260807 19:55:28.165143 11502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:28.152602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56208 (local address 127.5.197.129:44545)
0807 19:55:28.152780 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:28.152785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:28.153057 (+ 272us) server_negotiation.cc:407] Connection header received
0807 19:55:28.153174 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:28.153179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:28.153266 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:28.153359 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:28.154564 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.155314 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.156678 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.157110 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.157209 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:28.159551 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:28.159557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:28.159560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:28.159599 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:28.162322 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.163109 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.163114 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.163116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.163267 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.163745 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.163751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.163753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.164040 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:28.164239 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:28.164683 (+ 444us) server_negotiation.cc:299] Negotiation successful
0807 19:55:28.164881 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:55:28.165874 11124 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:28.250268 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 10948
I20260807 19:55:28.272590 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 11137
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:55:28.289465 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:28.273702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55370 (local address 127.5.197.130:37965)
0807 19:55:28.274295 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:28.274303 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:28.274330 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:55:28.274396 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:28.274403 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:28.274620 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:28.274784 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:28.276157 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.277274 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.278532 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.279131 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.279249 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:28.283591 (+ 4342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:28.283610 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:28.283632 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:28.283710 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:28.286469 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.287198 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.287205 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.287208 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.287335 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.287829 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.287834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.287836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.288262 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:28.288523 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:28.288819 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 19:55:28.289053 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":269,"threads_started":1}
I20260807 19:55:28.290848 11305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:28.377048 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 11137
I20260807 19:55:28.401794 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 11320
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[10801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:55:28.418707 11509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:28.402913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46170 (local address 127.5.197.131:34441)
0807 19:55:28.403616 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:28.403624 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:28.403655 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:55:28.403818 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:28.403825 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:28.404103 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:28.404344 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:28.405678 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.406743 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.408141 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:28.408719 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:28.408837 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:28.413104 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:28.413115 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:28.413130 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:28.413166 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:28.415931 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.416596 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.416602 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.416605 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.416739 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:28.417115 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:28.417119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:28.417122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:28.417471 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:28.417777 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:28.418107 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 19:55:28.418369 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":356,"threads_started":1}
I20260807 19:55:28.420078 11486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:28.502549 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 11320
I20260807 19:55:28.525362 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 10817
I20260807 19:55:28.526556 10908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:28.629439 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 10817
2026-08-07T19:55:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4076 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[11515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[11515](info): set up 2 sockets
Aug 07 19:55:28 dist-test-slave-6bbx krb5kdc[11515](info): commencing operation
krb5kdc: starting...
W20260807 19:55:29.826251 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:29 dist-test-slave-6bbx krb5kdc[11515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:30.058995 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33081
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:33081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:30.396441 11532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:30.396778 11532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:30.396922 11532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:30.404179 11532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:30.404312 11532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:30.404395 11532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:30.404474 11532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:30.404539 11532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:30.414546 11532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:33081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:30.415920 11532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:30.417250 11532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:30.429090 11541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:30.429167 11544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:30.429127 11542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:30.429809 11532 server_base.cc:1034] running on GCE node
I20260807 19:55:30.430601 11532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:30.431986 11532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:30.433182 11532 hybrid_clock.cc:648] HybridClock initialized: now 1786132530433122 us; error 54 us; skew 500 ppm
I20260807 19:55:30.433530 11532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:30 dist-test-slave-6bbx krb5kdc[11515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132530, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:30.442169 11532 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:30.443261 11532 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:30.443357 11532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:30.443625 11532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:30.446557 11532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "64ed04b464564750873eae7daba14179"
format_stamp: "Formatted at 2026-08-07 19:55:30 on dist-test-slave-6bbx"
server_key: "57953cdeca8a2444984e0f1f4801252a"
server_key_iv: "12aef2787117feec5070873d5c799697"
server_key_version: "encryptionkey@0"
I20260807 19:55:30.447304 11532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "64ed04b464564750873eae7daba14179"
format_stamp: "Formatted at 2026-08-07 19:55:30 on dist-test-slave-6bbx"
server_key: "57953cdeca8a2444984e0f1f4801252a"
server_key_iv: "12aef2787117feec5070873d5c799697"
server_key_version: "encryptionkey@0"
I20260807 19:55:30.452215 11532 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:55:30.455467 11551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:30.456825 11532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:30.457003 11532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "64ed04b464564750873eae7daba14179"
format_stamp: "Formatted at 2026-08-07 19:55:30 on dist-test-slave-6bbx"
server_key: "57953cdeca8a2444984e0f1f4801252a"
server_key_iv: "12aef2787117feec5070873d5c799697"
server_key_version: "encryptionkey@0"
I20260807 19:55:30.457300 11532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:30.489214 11532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:30.493150 11532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:30.493400 11532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:30.510776 11532 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:33081
I20260807 19:55:30.510751 11625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:33081 every 8 connection(s)
I20260807 19:55:30.511623 11532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:30.515163 11626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:30.521706 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 11532
I20260807 19:55:30.521950 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:30.522770 5910 external_mini_cluster.cc:1428] Setting key 7dbf16f4e0a00e6eb2642535622b0f00
I20260807 19:55:30.526194 11626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179: Bootstrap starting.
I20260807 19:55:30.529644 11626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:30.530727 11626 log.cc:824] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:30.533633 11626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179: No bootstrap required, opened a new log
Aug 07 19:55:30 dist-test-slave-6bbx krb5kdc[11515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:30.542855 11626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ed04b464564750873eae7daba14179" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33081 } }
I20260807 19:55:30.543315 11626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:30.543426 11626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ed04b464564750873eae7daba14179, State: Initialized, Role: FOLLOWER
I20260807 19:55:30.544106 11626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ed04b464564750873eae7daba14179" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33081 } }
I20260807 19:55:30.544394 11626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:30.544550 11626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:30.544739 11626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:30.546247 11629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:30.524879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43816 (local address 127.5.197.190:33081)
0807 19:55:30.525616 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:30.525627 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:30.525668 (+ 41us) server_negotiation.cc:407] Connection header received
0807 19:55:30.527352 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:30.527376 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:30.527800 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:30.528120 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:30.530037 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:30.531430 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:30.532827 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:30.533835 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:30.534012 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:30.537843 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:30.537853 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:30.537875 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:30.537928 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:30.541756 (+ 3828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:30.542378 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:30.542385 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:30.542392 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:30.542608 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:30.542958 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:30.542963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:30.542966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:30.543737 (+ 771us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:30.544024 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:30.544439 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 19:55:30.544886 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":344,"threads_started":1}
I20260807 19:55:30.547572 11626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ed04b464564750873eae7daba14179" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33081 } }
I20260807 19:55:30.548224 11626 leader_election.cc:302] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64ed04b464564750873eae7daba14179; no voters:
I20260807 19:55:30.548903 11626 leader_election.cc:288] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:30.549005 11633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:30.550175 11633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [term 1 LEADER]: Becoming Leader. State: Replica: 64ed04b464564750873eae7daba14179, State: Running, Role: LEADER
I20260807 19:55:30.550628 11633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ed04b464564750873eae7daba14179" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33081 } }
I20260807 19:55:30.550884 11626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:30.553388 11635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64ed04b464564750873eae7daba14179. Latest consensus state: current_term: 1 leader_uuid: "64ed04b464564750873eae7daba14179" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ed04b464564750873eae7daba14179" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33081 } } }
I20260807 19:55:30.553781 11635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:30.553809 11634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64ed04b464564750873eae7daba14179" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ed04b464564750873eae7daba14179" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33081 } } }
I20260807 19:55:30.554129 11634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:30.555755 11642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:30.560724 11642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:30.569720 11642 catalog_manager.cc:1347] Generated new cluster ID: 9d37c5390e3a49e1bbdf8d2eca69ecff
I20260807 19:55:30.569834 11642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:30.610757 11642 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:30.612106 11642 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:30.619495 11642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179: Generated new TSK 0
I20260807 19:55:30.620332 11642 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:55:30.689214 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33081
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:31.030522 11663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:31.030794 11663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:31.030920 11663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:31.038259 11663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:31.038376 11663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:31.038515 11663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:31.048525 11663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:31.049854 11663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:31.051291 11663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:31.064674 11671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:31.064776 11675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:31.064704 11669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:31.065865 11663 server_base.cc:1034] running on GCE node
I20260807 19:55:31.066569 11663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:31.067607 11663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:31.068876 11663 hybrid_clock.cc:648] HybridClock initialized: now 1786132531068819 us; error 42 us; skew 500 ppm
I20260807 19:55:31.069231 11663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:31 dist-test-slave-6bbx krb5kdc[11515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132531, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:31.072525 11663 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:55:31.073765 11663 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:31.073877 11663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:31.074199 11663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:31.078339 11663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "01784ee062ad4588b42c653eb7174dd2"
format_stamp: "Formatted at 2026-08-07 19:55:31 on dist-test-slave-6bbx"
server_key: "4f698d320c100f5fbc8d044db47ae224"
server_key_iv: "28e7bff49d949cc0523fd7c014308f10"
server_key_version: "encryptionkey@0"
I20260807 19:55:31.079397 11663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "01784ee062ad4588b42c653eb7174dd2"
format_stamp: "Formatted at 2026-08-07 19:55:31 on dist-test-slave-6bbx"
server_key: "4f698d320c100f5fbc8d044db47ae224"
server_key_iv: "28e7bff49d949cc0523fd7c014308f10"
server_key_version: "encryptionkey@0"
I20260807 19:55:31.085081 11663 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 19:55:31.088796 11682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:31.090121 11663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:31.090302 11663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "01784ee062ad4588b42c653eb7174dd2"
format_stamp: "Formatted at 2026-08-07 19:55:31 on dist-test-slave-6bbx"
server_key: "4f698d320c100f5fbc8d044db47ae224"
server_key_iv: "28e7bff49d949cc0523fd7c014308f10"
server_key_version: "encryptionkey@0"
I20260807 19:55:31.090528 11663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:31.109043 11663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:31.113358 11663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:31.113626 11663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:31.114694 11663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:31.116201 11663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:31.116302 11663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:31.116415 11663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:31.116487 11663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:31.148487 11663 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:39249
I20260807 19:55:31.148540 11845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:39249 every 8 connection(s)
I20260807 19:55:31.149343 11663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:31.155038 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 11663
I20260807 19:55:31.155247 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:31.156141 5910 external_mini_cluster.cc:1428] Setting key 6543a718263a257596a72e679e50c80e
Aug 07 19:55:31 dist-test-slave-6bbx krb5kdc[11515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132531, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:31.171237 11850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:31.151889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:38621 (local address 127.5.197.190:33081)
0807 19:55:31.152347 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:31.152351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:31.153310 (+ 959us) server_negotiation.cc:407] Connection header received
0807 19:55:31.155184 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:31.155190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:31.155296 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:31.155410 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:31.157464 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.158344 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.160639 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.161126 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.161226 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:31.165319 (+ 4093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:31.165324 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:31.165328 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:31.165364 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:31.167968 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:31.168790 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:31.168796 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:31.168799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:31.168953 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:31.169379 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:31.169385 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:31.169388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:31.169745 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:31.169897 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:31.170650 (+ 753us) server_negotiation.cc:299] Negotiation successful
0807 19:55:31.170893 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":232,"threads_started":1}
I20260807 19:55:31.172151 11852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:31.152353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33081 (local address 127.5.197.129:38621)
0807 19:55:31.153094 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:31.153141 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:31.154909 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:31.155723 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:31.155737 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:31.156547 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:31.157234 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:31.157259 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.158520 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.158526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:31.160480 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:31.160497 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.161361 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.161368 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:31.161628 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:31.162339 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:31.162368 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:31.165058 (+ 2690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:31.168150 (+ 3092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:31.168158 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:31.168173 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:31.168650 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:31.169050 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:31.169054 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:31.169056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:31.169239 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:31.169859 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:31.169864 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:31.170213 (+ 349us) client_negotiation.cc:769] Sending connection context
0807 19:55:31.170485 (+ 272us) client_negotiation.cc:240] Negotiation successful
0807 19:55:31.170922 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":289,"threads_started":1}
I20260807 19:55:31.173887 11846 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33081
I20260807 19:55:31.174207 11846 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:31.174917 11846 heartbeater.cc:511] Master 127.5.197.190:33081 requested a full tablet report, sending...
I20260807 19:55:31.177273 11575 ts_manager.cc:194] Registered new tserver with Master: 01784ee062ad4588b42c653eb7174dd2 (127.5.197.129:39249)
I20260807 19:55:31.178828 11575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:38621
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:55:31.212771 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33081
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:31.551997 11856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:31.552309 11856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:31.552464 11856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:31.559504 11856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:31.559597 11856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:31.559775 11856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:31.569325 11856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:31.570696 11856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:31.572065 11856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:31.584846 11861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:31.584914 11863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:31.584895 11865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:31.585776 11856 server_base.cc:1034] running on GCE node
I20260807 19:55:31.586378 11856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:31.587291 11856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:31.588501 11856 hybrid_clock.cc:648] HybridClock initialized: now 1786132531588453 us; error 43 us; skew 500 ppm
I20260807 19:55:31.588824 11856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:31 dist-test-slave-6bbx krb5kdc[11515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132531, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:31.592096 11856 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:55:31.593350 11856 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:31.593457 11856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:31.593786 11856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:31.596931 11856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "9f51877cdcae43a9bc504b250c5f89e2"
format_stamp: "Formatted at 2026-08-07 19:55:31 on dist-test-slave-6bbx"
server_key: "cac06f436d5a89b9da06b3ce622d10dc"
server_key_iv: "fd69b3d749f6357978be3f34ba6b4233"
server_key_version: "encryptionkey@0"
I20260807 19:55:31.597780 11856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "9f51877cdcae43a9bc504b250c5f89e2"
format_stamp: "Formatted at 2026-08-07 19:55:31 on dist-test-slave-6bbx"
server_key: "cac06f436d5a89b9da06b3ce622d10dc"
server_key_iv: "fd69b3d749f6357978be3f34ba6b4233"
server_key_version: "encryptionkey@0"
I20260807 19:55:31.602818 11856 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:55:31.606343 11873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:31.607707 11856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 19:55:31.607877 11856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "9f51877cdcae43a9bc504b250c5f89e2"
format_stamp: "Formatted at 2026-08-07 19:55:31 on dist-test-slave-6bbx"
server_key: "cac06f436d5a89b9da06b3ce622d10dc"
server_key_iv: "fd69b3d749f6357978be3f34ba6b4233"
server_key_version: "encryptionkey@0"
I20260807 19:55:31.608073 11856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:31.628876 11856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:31.633030 11856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:31.633287 11856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:31.634245 11856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:31.635618 11856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:31.635737 11856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:31.635850 11856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:31.635926 11856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:31.667364 11856 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41665
I20260807 19:55:31.667410 12032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41665 every 8 connection(s)
I20260807 19:55:31.668308 11856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:31.677580 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 11856
I20260807 19:55:31.677778 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:31.678363 5910 external_mini_cluster.cc:1428] Setting key e0ea45694770a393f02c99e448073af6
Aug 07 19:55:31 dist-test-slave-6bbx krb5kdc[11515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132531, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:31.689620 11850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:31.670861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:37653 (local address 127.5.197.190:33081)
0807 19:55:31.671046 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:31.671051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:31.672300 (+ 1249us) server_negotiation.cc:407] Connection header received
0807 19:55:31.674182 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:31.674188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:31.674287 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:31.674377 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:31.676027 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.676750 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.678917 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.679481 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.679583 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:31.683411 (+ 3828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:31.683418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:31.683422 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:31.683460 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:31.686411 (+ 2951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:31.687244 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:31.687250 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:31.687253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:31.687409 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:31.687834 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:31.687838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:31.687841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:31.688165 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:31.688323 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:31.689059 (+ 736us) server_negotiation.cc:299] Negotiation successful
0807 19:55:31.689292 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:55:31.690747 12035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:31.671335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33081 (local address 127.5.197.130:37653)
0807 19:55:31.672108 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:31.672157 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:31.673888 (+ 1731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:31.674633 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:31.674641 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:31.675194 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:31.675846 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:31.675867 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.676896 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.676900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:31.678769 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:31.678785 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:31.679740 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:31.679749 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:31.680039 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:31.680755 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:31.680783 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:31.683167 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:31.686616 (+ 3449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:31.686624 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:31.686637 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:31.687110 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:31.687500 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:31.687503 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:31.687505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:31.687706 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:31.688332 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:31.688339 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:31.688690 (+ 351us) client_negotiation.cc:769] Sending connection context
0807 19:55:31.688936 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 19:55:31.689362 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":324,"threads_started":1}
I20260807 19:55:31.692448 12033 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33081
I20260807 19:55:31.692808 12033 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:31.693608 12033 heartbeater.cc:511] Master 127.5.197.190:33081 requested a full tablet report, sending...
I20260807 19:55:31.695425 11575 ts_manager.cc:194] Registered new tserver with Master: 9f51877cdcae43a9bc504b250c5f89e2 (127.5.197.130:41665)
I20260807 19:55:31.696588 11575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:37653
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:55:31.735085 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33081
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:32.066393 12039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:32.066704 12039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:32.066838 12039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:32.074137 12039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:32.074308 12039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:32.074522 12039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:32.084606 12039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:32.085999 12039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:32.087359 12039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:32.100231 12047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:32.100231 12045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:32.100330 12044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:32.101111 12039 server_base.cc:1034] running on GCE node
I20260807 19:55:32.101698 12039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:32.102694 12039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:32.103915 12039 hybrid_clock.cc:648] HybridClock initialized: now 1786132532103858 us; error 45 us; skew 500 ppm
I20260807 19:55:32.104225 12039 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:32 dist-test-slave-6bbx krb5kdc[11515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132532, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:32.107546 12039 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:55:32.108711 12039 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:32.108806 12039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:32.109113 12039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:32.112305 12039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "4b43fc43d8d4463686814c92099d1576"
format_stamp: "Formatted at 2026-08-07 19:55:32 on dist-test-slave-6bbx"
server_key: "5ee4d445639b0a46c452a88a066c3cd3"
server_key_iv: "dbc7ff5e44b412eafe1f30afe0b406c4"
server_key_version: "encryptionkey@0"
I20260807 19:55:32.113149 12039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "4b43fc43d8d4463686814c92099d1576"
format_stamp: "Formatted at 2026-08-07 19:55:32 on dist-test-slave-6bbx"
server_key: "5ee4d445639b0a46c452a88a066c3cd3"
server_key_iv: "dbc7ff5e44b412eafe1f30afe0b406c4"
server_key_version: "encryptionkey@0"
I20260807 19:55:32.118500 12039 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:55:32.122180 12056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:32.123528 12039 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:32.123709 12039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "4b43fc43d8d4463686814c92099d1576"
format_stamp: "Formatted at 2026-08-07 19:55:32 on dist-test-slave-6bbx"
server_key: "5ee4d445639b0a46c452a88a066c3cd3"
server_key_iv: "dbc7ff5e44b412eafe1f30afe0b406c4"
server_key_version: "encryptionkey@0"
I20260807 19:55:32.123937 12039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:32.150638 12039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:32.155287 12039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:32.155580 12039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:32.156656 12039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:32.158092 12039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:32.158205 12039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:32.158327 12039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:32.158401 12039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:32.182261 11846 heartbeater.cc:503] Master 127.5.197.190:33081 was elected leader, sending a full tablet report...
I20260807 19:55:32.190822 12039 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:35801
I20260807 19:55:32.190883 12214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:35801 every 8 connection(s)
I20260807 19:55:32.191816 12039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:32.198956 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 12039
I20260807 19:55:32.199115 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:32.199546 5910 external_mini_cluster.cc:1428] Setting key 74cefe6f49b1206cee7882a02c4616f9
Aug 07 19:55:32 dist-test-slave-6bbx krb5kdc[11515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132532, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:32.211767 12217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.194132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:54517 (local address 127.5.197.190:33081)
0807 19:55:32.194588 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.194593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.195566 (+ 973us) server_negotiation.cc:407] Connection header received
0807 19:55:32.197510 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.197515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.197606 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.197706 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:32.199318 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.200192 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.202347 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.202890 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.202988 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.206465 (+ 3477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:32.206470 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:32.206473 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:32.206509 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:32.208959 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.209664 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.209667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.209669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.209799 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.210165 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.210168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.210170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.210454 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:32.210573 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.211238 (+ 665us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.211419 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":218,"threads_started":1}
I20260807 19:55:32.212942 12218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.194712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33081 (local address 127.5.197.131:54517)
0807 19:55:32.195415 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:32.195455 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:32.197227 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:32.197954 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:32.197963 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:32.198495 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:32.199130 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.199152 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.200398 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.200404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.202200 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.202214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.203091 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.203096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.203316 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.203968 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:32.203993 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:32.206238 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:32.209102 (+ 2864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:32.209109 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:32.209122 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:32.209571 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:32.209879 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:32.209882 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:32.209884 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:32.210069 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:32.210555 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:32.210561 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:32.210924 (+ 363us) client_negotiation.cc:769] Sending connection context
0807 19:55:32.211162 (+ 238us) client_negotiation.cc:240] Negotiation successful
0807 19:55:32.211597 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":268,"threads_started":1}
I20260807 19:55:32.214701 12215 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33081
I20260807 19:55:32.215078 12215 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:32.215852 12215 heartbeater.cc:511] Master 127.5.197.190:33081 requested a full tablet report, sending...
I20260807 19:55:32.217280 11575 ts_manager.cc:194] Registered new tserver with Master: 4b43fc43d8d4463686814c92099d1576 (127.5.197.131:35801)
I20260807 19:55:32.218096 11575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:54517
I20260807 19:55:32.227558 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:55:32.244808 12217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.232177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43824 (local address 127.5.197.190:33081)
0807 19:55:32.232335 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.232342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.232825 (+ 483us) server_negotiation.cc:407] Connection header received
0807 19:55:32.232999 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.233004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.233086 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.233170 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:32.234596 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.235335 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.236658 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.237084 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.237195 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.239521 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:32.239526 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:32.239529 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:32.239565 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:32.241971 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.242674 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.242678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.242680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.242815 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.243208 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.243212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.243214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.243574 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:32.243846 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.244234 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.244513 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 19:55:32.249336 11575 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:32.256686 11575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:32.280480 12232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.269860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47068 (local address 127.5.197.130:41665)
0807 19:55:32.270448 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.270459 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.271049 (+ 590us) server_negotiation.cc:407] Connection header received
0807 19:55:32.271515 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.271523 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.271808 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.271993 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:32.272961 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.274540 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.277508 (+ 2968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.278980 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.279120 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.279324 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.279988 (+ 664us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.280160 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":256,"threads_started":1}
I20260807 19:55:32.280514 12231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.269608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41665 (local address 127.0.0.1:47068)
0807 19:55:32.270883 (+ 1275us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:32.270925 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:32.271234 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:32.272261 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:32.272269 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:32.272299 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:32.272731 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.272743 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.274719 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.274736 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.277313 (+ 2577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.277329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.279465 (+ 2136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.279473 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.279716 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.279784 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 19:55:32.279913 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 19:55:32.280108 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":994,"mutex_wait_us":20,"thread_start_us":1710,"threads_started":1}
I20260807 19:55:32.280982 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.270305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.5.197.131:35801)
0807 19:55:32.271102 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.271109 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.271723 (+ 614us) server_negotiation.cc:407] Connection header received
0807 19:55:32.272010 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.272017 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.272234 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.272417 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:32.273401 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.274878 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.277962 (+ 3084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.279358 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.279487 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.279732 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.280022 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.280199 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":468,"threads_started":1}
I20260807 19:55:32.281893 12230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.269841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:35801 (local address 127.0.0.1:38580)
0807 19:55:32.271577 (+ 1736us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:32.271594 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:32.271818 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:32.272702 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:32.272706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:32.272736 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:32.273166 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.273180 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.275037 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.275042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.277784 (+ 2742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.277800 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.279577 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.279584 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.279811 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.279848 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:55:32.281294 (+ 1446us) client_negotiation.cc:240] Negotiation successful
0807 19:55:32.281439 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1621,"mutex_wait_us":554,"thread_start_us":630,"threads_started":1}
I20260807 19:55:32.284896 12235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.271724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39249 (local address 127.0.0.1:32836)
0807 19:55:32.277559 (+ 5835us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:32.277576 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:32.277702 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:32.278430 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:32.278434 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:32.278458 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:32.278834 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.278844 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.280554 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.280559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.282470 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.282485 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.284112 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.284119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.284297 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.284331 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:55:32.284421 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 19:55:32.284545 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5720,"thread_start_us":5540,"threads_started":1}
I20260807 19:55:32.285722 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.272086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32836 (local address 127.5.197.129:39249)
0807 19:55:32.277240 (+ 5154us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.277249 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.277842 (+ 593us) server_negotiation.cc:407] Connection header received
0807 19:55:32.277948 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.277956 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.278213 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.278411 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:32.278984 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.280346 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.282633 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.283902 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.284039 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.284276 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.285212 (+ 936us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.285395 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4950,"thread_start_us":4782,"threads_started":1}
I20260807 19:55:32.285501 11940 tablet_service.cc:1467] Processing CreateTablet for tablet 7525ccb3f6df470bb297d5de53b6f082 (DEFAULT_TABLE table=test-table [id=d11a9017e57548a89fc367a5852a3c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:32.286253 12121 tablet_service.cc:1467] Processing CreateTablet for tablet 7525ccb3f6df470bb297d5de53b6f082 (DEFAULT_TABLE table=test-table [id=d11a9017e57548a89fc367a5852a3c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:32.287189 11940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7525ccb3f6df470bb297d5de53b6f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:32.287658 12121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7525ccb3f6df470bb297d5de53b6f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:32.288764 11751 tablet_service.cc:1467] Processing CreateTablet for tablet 7525ccb3f6df470bb297d5de53b6f082 (DEFAULT_TABLE table=test-table [id=d11a9017e57548a89fc367a5852a3c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:32.290108 11751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7525ccb3f6df470bb297d5de53b6f082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:32.302071 12241 tablet_bootstrap.cc:492] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Bootstrap starting.
I20260807 19:55:32.303154 12243 tablet_bootstrap.cc:492] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Bootstrap starting.
I20260807 19:55:32.304718 12244 tablet_bootstrap.cc:492] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Bootstrap starting.
I20260807 19:55:32.306882 12241 tablet_bootstrap.cc:654] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:32.306880 12243 tablet_bootstrap.cc:654] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:32.307992 12244 tablet_bootstrap.cc:654] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:32.308279 12243 log.cc:824] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:32.308426 12241 log.cc:824] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:32.309281 12244 log.cc:824] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:32.311915 12243 tablet_bootstrap.cc:492] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: No bootstrap required, opened a new log
I20260807 19:55:32.311915 12241 tablet_bootstrap.cc:492] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: No bootstrap required, opened a new log
I20260807 19:55:32.312227 12243 ts_tablet_manager.cc:1397] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.000s
I20260807 19:55:32.312222 12241 ts_tablet_manager.cc:1397] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260807 19:55:32.314083 12244 tablet_bootstrap.cc:492] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: No bootstrap required, opened a new log
I20260807 19:55:32.314347 12244 ts_tablet_manager.cc:1397] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 19:55:32.321818 12244 raft_consensus.cc:348] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.322257 12244 raft_consensus.cc:374] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:32.323019 12241 raft_consensus.cc:348] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.323019 12243 raft_consensus.cc:348] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.323374 12244 raft_consensus.cc:729] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f51877cdcae43a9bc504b250c5f89e2, State: Initialized, Role: FOLLOWER
I20260807 19:55:32.323470 12243 raft_consensus.cc:374] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:32.323508 12241 raft_consensus.cc:374] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:32.323591 12241 raft_consensus.cc:729] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01784ee062ad4588b42c653eb7174dd2, State: Initialized, Role: FOLLOWER
I20260807 19:55:32.323582 12243 raft_consensus.cc:729] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b43fc43d8d4463686814c92099d1576, State: Initialized, Role: FOLLOWER
I20260807 19:55:32.324213 12244 consensus_queue.cc:260] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.324221 12241 consensus_queue.cc:260] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.324231 12243 consensus_queue.cc:260] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.325351 12033 heartbeater.cc:503] Master 127.5.197.190:33081 was elected leader, sending a full tablet report...
I20260807 19:55:32.326138 12244 ts_tablet_manager.cc:1428] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260807 19:55:32.331424 12215 heartbeater.cc:503] Master 127.5.197.190:33081 was elected leader, sending a full tablet report...
I20260807 19:55:32.332617 12243 ts_tablet_manager.cc:1428] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Time spent starting tablet: real 0.020s user 0.015s sys 0.004s
I20260807 19:55:32.334290 12241 ts_tablet_manager.cc:1428] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Time spent starting tablet: real 0.022s user 0.013s sys 0.008s
W20260807 19:55:32.401674 11847 tablet.cc:2369] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:55:32.420203 12034 tablet.cc:2369] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:55:32.443305 12216 tablet.cc:2369] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:32.518783 12248 raft_consensus.cc:482] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:32.519127 12248 raft_consensus.cc:504] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.520988 12248 leader_election.cc:288] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b43fc43d8d4463686814c92099d1576 (127.5.197.131:35801), 01784ee062ad4588b42c653eb7174dd2 (127.5.197.129:39249)
I20260807 19:55:32.528167 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.521745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:57045 (local address 127.5.197.129:39249)
0807 19:55:32.521931 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.521937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.522511 (+ 574us) server_negotiation.cc:407] Connection header received
0807 19:55:32.522794 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.522798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.522860 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.522934 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:32.523594 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.524438 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.526362 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.527219 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.527383 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.527439 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.527794 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.527927 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 19:55:32.528306 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.521278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39249 (local address 127.5.197.130:57045)
0807 19:55:32.522380 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:32.522413 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:32.522638 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:32.522989 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:32.522993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:32.523014 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:32.523431 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.523444 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.524575 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.524581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.526200 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.526213 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.527427 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.527434 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.527595 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.527630 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:55:32.527759 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 19:55:32.527885 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":962,"mutex_wait_us":25,"thread_start_us":738,"threads_started":1}
I20260807 19:55:32.528708 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.521353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:35801 (local address 127.5.197.130:51711)
0807 19:55:32.522641 (+ 1288us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:32.522658 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:32.522845 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:32.523209 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:32.523213 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:32.523238 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:32.523628 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.523640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.524951 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.524954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.526461 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:32.526475 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.527770 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.527776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:32.527962 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.527994 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:55:32.528081 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 19:55:32.528198 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"mutex_wait_us":20,"thread_start_us":969,"threads_started":1}
I20260807 19:55:32.528844 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.521615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:51711 (local address 127.5.197.131:35801)
0807 19:55:32.521843 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.521850 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.522744 (+ 894us) server_negotiation.cc:407] Connection header received
0807 19:55:32.523003 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.523008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.523084 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.523165 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:32.523847 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.524813 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.526613 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.527539 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.527701 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.527774 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.528123 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.528261 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:55:32.529423 11778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7525ccb3f6df470bb297d5de53b6f082" candidate_uuid: "9f51877cdcae43a9bc504b250c5f89e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01784ee062ad4588b42c653eb7174dd2" is_pre_election: true
I20260807 19:55:32.529780 12150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7525ccb3f6df470bb297d5de53b6f082" candidate_uuid: "9f51877cdcae43a9bc504b250c5f89e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b43fc43d8d4463686814c92099d1576" is_pre_election: true
I20260807 19:55:32.529924 11778 raft_consensus.cc:2454] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f51877cdcae43a9bc504b250c5f89e2 in term 0.
I20260807 19:55:32.530236 12150 raft_consensus.cc:2454] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f51877cdcae43a9bc504b250c5f89e2 in term 0.
I20260807 19:55:32.530581 11874 leader_election.cc:302] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01784ee062ad4588b42c653eb7174dd2, 9f51877cdcae43a9bc504b250c5f89e2; no voters:
I20260807 19:55:32.530979 12248 raft_consensus.cc:2781] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:32.531132 12248 raft_consensus.cc:482] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:32.531242 12248 raft_consensus.cc:3037] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:32.533520 12248 raft_consensus.cc:504] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.534068 12248 leader_election.cc:288] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [CANDIDATE]: Term 1 election: Requested vote from peers 4b43fc43d8d4463686814c92099d1576 (127.5.197.131:35801), 01784ee062ad4588b42c653eb7174dd2 (127.5.197.129:39249)
I20260807 19:55:32.534446 12150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7525ccb3f6df470bb297d5de53b6f082" candidate_uuid: "9f51877cdcae43a9bc504b250c5f89e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b43fc43d8d4463686814c92099d1576"
I20260807 19:55:32.534557 11778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7525ccb3f6df470bb297d5de53b6f082" candidate_uuid: "9f51877cdcae43a9bc504b250c5f89e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01784ee062ad4588b42c653eb7174dd2"
I20260807 19:55:32.534659 12150 raft_consensus.cc:3037] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:32.534760 11778 raft_consensus.cc:3037] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:32.537792 12150 raft_consensus.cc:2454] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f51877cdcae43a9bc504b250c5f89e2 in term 1.
I20260807 19:55:32.537792 11778 raft_consensus.cc:2454] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f51877cdcae43a9bc504b250c5f89e2 in term 1.
I20260807 19:55:32.538165 11874 leader_election.cc:302] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01784ee062ad4588b42c653eb7174dd2, 9f51877cdcae43a9bc504b250c5f89e2; no voters:
I20260807 19:55:32.538450 12248 raft_consensus.cc:2781] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:32.538874 12248 raft_consensus.cc:686] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9f51877cdcae43a9bc504b250c5f89e2, State: Running, Role: LEADER
I20260807 19:55:32.539398 12248 consensus_queue.cc:237] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } }
I20260807 19:55:32.543720 11574 catalog_manager.cc:5495] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f51877cdcae43a9bc504b250c5f89e2 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "9f51877cdcae43a9bc504b250c5f89e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f51877cdcae43a9bc504b250c5f89e2" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:32.585450 12232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.580048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47084 (local address 127.5.197.130:41665)
0807 19:55:32.580268 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.580274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.580295 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:55:32.580413 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.580417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.580501 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.580640 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:32.581040 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.581811 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.583214 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.583641 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.583791 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.584297 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:32.584826 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:32.584988 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.585083 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.585171 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:55:32.594033 11778 raft_consensus.cc:1261] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 1 FOLLOWER]: Refusing update from remote peer 9f51877cdcae43a9bc504b250c5f89e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:32.594034 12150 raft_consensus.cc:1261] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 1 FOLLOWER]: Refusing update from remote peer 9f51877cdcae43a9bc504b250c5f89e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:32.595012 12254 consensus_queue.cc:1035] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b43fc43d8d4463686814c92099d1576" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:32.595410 12248 consensus_queue.cc:1035] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01784ee062ad4588b42c653eb7174dd2" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:32.614606 12262 mvcc.cc:205] Tried to move back new op lower bound from 7315998853494292480 to 7315998853285146624. Current Snapshot: MvccSnapshot[applied={T|T < 7315998853494292480 or (T in {7315998853494292480})}]
I20260807 19:55:32.624341 11575 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:32.624668 11575 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:32.628899 11575 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64ed04b464564750873eae7daba14179: Sending DeleteTablet for 3 replicas of tablet 7525ccb3f6df470bb297d5de53b6f082
I20260807 19:55:32.630268 12121 tablet_service.cc:1514] Processing DeleteTablet for tablet 7525ccb3f6df470bb297d5de53b6f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:32 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:38580
I20260807 19:55:32.630337 11751 tablet_service.cc:1514] Processing DeleteTablet for tablet 7525ccb3f6df470bb297d5de53b6f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:32 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:32836
I20260807 19:55:32.631229 12275 tablet_replica.cc:330] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: stopping tablet replica
I20260807 19:55:32.631469 12276 tablet_replica.cc:330] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: stopping tablet replica
I20260807 19:55:32.631814 12275 raft_consensus.cc:2229] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:32.632489 12275 raft_consensus.cc:2258] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:32.632663 11940 tablet_service.cc:1514] Processing DeleteTablet for tablet 7525ccb3f6df470bb297d5de53b6f082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:32 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:47068
I20260807 19:55:32.633666 12278 tablet_replica.cc:330] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: stopping tablet replica
I20260807 19:55:32.633831 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 11663
I20260807 19:55:32.634172 12278 raft_consensus.cc:2229] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:32.634918 12278 raft_consensus.cc:2258] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:32.638530 12278 ts_tablet_manager.cc:1905] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:32.632001 12276 raft_consensus.cc:2229] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:32.644081 12276 raft_consensus.cc:2258] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:32.645843 12275 ts_tablet_manager.cc:1905] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:32.647521 12278 ts_tablet_manager.cc:1918] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:32.647828 12278 log.cc:1196] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/7525ccb3f6df470bb297d5de53b6f082
I20260807 19:55:32.648547 12278 ts_tablet_manager.cc:1939] T 7525ccb3f6df470bb297d5de53b6f082 P 9f51877cdcae43a9bc504b250c5f89e2: Deleting consensus metadata
I20260807 19:55:32.650787 11552 catalog_manager.cc:4841] TS 9f51877cdcae43a9bc504b250c5f89e2 (127.5.197.130:41665): tablet 7525ccb3f6df470bb297d5de53b6f082 (table test-table [id=d11a9017e57548a89fc367a5852a3c65]) successfully deleted
I20260807 19:55:32.652665 12276 ts_tablet_manager.cc:1905] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 19:55:32 dist-test-slave-6bbx krb5kdc[11515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:32.654693 12275 ts_tablet_manager.cc:1918] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:32.655019 12275 log.cc:1196] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/7525ccb3f6df470bb297d5de53b6f082
I20260807 19:55:32.655753 12275 ts_tablet_manager.cc:1939] T 7525ccb3f6df470bb297d5de53b6f082 P 4b43fc43d8d4463686814c92099d1576: Deleting consensus metadata
I20260807 19:55:32.658062 11555 catalog_manager.cc:4841] TS 4b43fc43d8d4463686814c92099d1576 (127.5.197.131:35801): tablet 7525ccb3f6df470bb297d5de53b6f082 (table test-table [id=d11a9017e57548a89fc367a5852a3c65]) successfully deleted
I20260807 19:55:32.661437 12276 ts_tablet_manager.cc:1918] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:32.661696 12276 log.cc:1196] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/7525ccb3f6df470bb297d5de53b6f082
I20260807 19:55:32.662292 12276 ts_tablet_manager.cc:1939] T 7525ccb3f6df470bb297d5de53b6f082 P 01784ee062ad4588b42c653eb7174dd2: Deleting consensus metadata
I20260807 19:55:32.664415 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.636853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32852 (local address 127.5.197.129:39249)
0807 19:55:32.637043 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.637049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.637069 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:55:32.637136 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.637142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.643232 (+ 6090us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.643398 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:32.645186 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.646347 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.648236 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.648846 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.648974 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.654313 (+ 5339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:32.654330 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:32.654351 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:32.654410 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:32.658411 (+ 4001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.659231 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.659239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.659241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.659432 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.659898 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.659902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.659904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.660372 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:32.660707 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.660995 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.661240 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:55:32.664543 11552 catalog_manager.cc:4841] TS 01784ee062ad4588b42c653eb7174dd2 (127.5.197.129:39249): tablet 7525ccb3f6df470bb297d5de53b6f082 (table test-table [id=d11a9017e57548a89fc367a5852a3c65]) successfully deleted
I20260807 19:55:32.665192 11838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:32.773663 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 11663
I20260807 19:55:32.799877 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 11856
Aug 07 19:55:32 dist-test-slave-6bbx krb5kdc[11515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:55:32.816425 12232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.800828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47088 (local address 127.5.197.130:41665)
0807 19:55:32.801042 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.801049 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.801072 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:55:32.801142 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.801148 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.801250 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.801358 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:32.802564 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.803873 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.805086 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.805762 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.805900 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.809876 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:32.809893 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:32.809914 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:32.809964 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:32.813569 (+ 3605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.814227 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.814235 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.814237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.814399 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.814792 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.814796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.814798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.815210 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:32.815537 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.815845 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.816080 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:55:32.817211 12028 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:32.934155 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 11856
I20260807 19:55:32.961843 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 12039
Aug 07 19:55:32 dist-test-slave-6bbx krb5kdc[11515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:55:32.977286 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:32.962699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38588 (local address 127.5.197.131:35801)
0807 19:55:32.962898 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:32.962903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:32.962923 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:55:32.963054 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:32.963058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:32.963123 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:32.963207 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:32.964588 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.965342 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.966599 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:32.967001 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:32.967109 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:32.971518 (+ 4409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:32.971534 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:32.971553 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:32.971590 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:32.974336 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.975059 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.975068 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.975070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.975220 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:32.975609 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:32.975613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:32.975615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:32.976083 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:32.976391 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:32.976716 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 19:55:32.976938 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:55:32.977960 12206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:33.066610 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 12039
I20260807 19:55:33.095767 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 11532
I20260807 19:55:33.096984 11621 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:33.208031 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 11532
2026-08-07T19:55:33Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4578 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T19:55:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:33Z Disabled control of system clock
I20260807 19:55:33.288678 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45291
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 19:55:33.615500 12291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:33.615857 12291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:33.615960 12291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:33.623183 12291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:33.623311 12291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:33.623348 12291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:33.623406 12291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:33.623449 12291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:33.633029 12291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45291
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:33.634352 12291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:33.636276 12291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:33.648336 12298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:33.648258 12299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:33.648340 12303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:33.649521 12291 server_base.cc:1034] running on GCE node
I20260807 19:55:33.650329 12291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:33.651780 12291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:33.652997 12291 hybrid_clock.cc:648] HybridClock initialized: now 1786132533652947 us; error 34 us; skew 500 ppm
I20260807 19:55:33.653355 12291 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:33.655825 12291 webserver.cc:460] Webserver started at http://127.5.197.190:39205/ using document root <none> and password file <none>
I20260807 19:55:33.656546 12291 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:33.656656 12291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:33.656996 12291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:33.660120 12291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "6184802eb2164dbf88ae738ff1dff16f"
format_stamp: "Formatted at 2026-08-07 19:55:33 on dist-test-slave-6bbx"
server_key: "901f4466df9e44492144c272b2663b99"
server_key_iv: "b76485cd124c474e3af46722d4fc076b"
server_key_version: "encryptionkey@0"
I20260807 19:55:33.660940 12291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "6184802eb2164dbf88ae738ff1dff16f"
format_stamp: "Formatted at 2026-08-07 19:55:33 on dist-test-slave-6bbx"
server_key: "901f4466df9e44492144c272b2663b99"
server_key_iv: "b76485cd124c474e3af46722d4fc076b"
server_key_version: "encryptionkey@0"
I20260807 19:55:33.666023 12291 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:33.669432 12310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:33.670768 12291 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:55:33.670948 12291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "6184802eb2164dbf88ae738ff1dff16f"
format_stamp: "Formatted at 2026-08-07 19:55:33 on dist-test-slave-6bbx"
server_key: "901f4466df9e44492144c272b2663b99"
server_key_iv: "b76485cd124c474e3af46722d4fc076b"
server_key_version: "encryptionkey@0"
I20260807 19:55:33.671144 12291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:33.676839 12291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:33.677570 12291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:33.677839 12291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:33.694900 12291 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:45291
I20260807 19:55:33.694922 12377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:45291 every 8 connection(s)
I20260807 19:55:33.696230 12291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:33.700230 12378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:33.700526 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 12291
I20260807 19:55:33.700760 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:33.701596 5910 external_mini_cluster.cc:1428] Setting key ba356e4cf5b46e630b6ee858984c11b3
I20260807 19:55:33.709975 12384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:33.703747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51528 (local address 127.5.197.190:45291)
0807 19:55:33.704806 (+ 1059us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:33.704817 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:33.704864 (+ 47us) server_negotiation.cc:407] Connection header received
0807 19:55:33.706524 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:33.706546 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:33.706943 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:33.707266 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:33.708452 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:33.708459 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:33.708471 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:33.708485 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:33.708549 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:33.708565 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:33.708729 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:33.708868 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 19:55:33.709101 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":397,"threads_started":1}
I20260807 19:55:33.713304 12378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f: Bootstrap starting.
I20260807 19:55:33.716241 12378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:33.717196 12378 log.cc:824] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:33.719844 12378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f: No bootstrap required, opened a new log
I20260807 19:55:33.726747 12378 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184802eb2164dbf88ae738ff1dff16f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45291 } }
I20260807 19:55:33.727108 12378 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:33.727198 12378 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6184802eb2164dbf88ae738ff1dff16f, State: Initialized, Role: FOLLOWER
I20260807 19:55:33.727756 12378 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184802eb2164dbf88ae738ff1dff16f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45291 } }
I20260807 19:55:33.727979 12378 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:33.728098 12378 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:33.728252 12378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:33.730320 12378 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184802eb2164dbf88ae738ff1dff16f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45291 } }
I20260807 19:55:33.730786 12378 leader_election.cc:302] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6184802eb2164dbf88ae738ff1dff16f; no voters:
I20260807 19:55:33.731384 12378 leader_election.cc:288] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:33.731511 12387 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:33.732225 12387 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [term 1 LEADER]: Becoming Leader. State: Replica: 6184802eb2164dbf88ae738ff1dff16f, State: Running, Role: LEADER
I20260807 19:55:33.732748 12387 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184802eb2164dbf88ae738ff1dff16f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45291 } }
I20260807 19:55:33.733377 12378 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:33.735404 12388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6184802eb2164dbf88ae738ff1dff16f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184802eb2164dbf88ae738ff1dff16f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45291 } } }
I20260807 19:55:33.735867 12388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:33.735657 12389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6184802eb2164dbf88ae738ff1dff16f. Latest consensus state: current_term: 1 leader_uuid: "6184802eb2164dbf88ae738ff1dff16f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184802eb2164dbf88ae738ff1dff16f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45291 } } }
I20260807 19:55:33.736022 12389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:33.737856 12393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:33.743019 12393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:33.752267 12393 catalog_manager.cc:1347] Generated new cluster ID: 3d12746cf5fe4018b06bf9c584bbd954
I20260807 19:55:33.752388 12393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:33.772894 12393 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:33.773376 12393 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:33.788268 12393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f: Generated new TSK 0
I20260807 19:55:33.789390 12393 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:55:33.794397 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45291
--builtin_ntp_servers=127.5.197.148:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 19:55:34.139698 12409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:34.139986 12409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:34.140125 12409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:34.147771 12409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:34.147886 12409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:34.148022 12409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:34.157176 12409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:34.158506 12409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:34.160458 12409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:34.173707 12414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:34.173664 12415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:34.173748 12418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:34.174675 12409 server_base.cc:1034] running on GCE node
I20260807 19:55:34.175277 12409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:34.176322 12409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:34.177528 12409 hybrid_clock.cc:648] HybridClock initialized: now 1786132534177484 us; error 36 us; skew 500 ppm
I20260807 19:55:34.177841 12409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:34.180173 12409 webserver.cc:460] Webserver started at http://127.5.197.129:34029/ using document root <none> and password file <none>
I20260807 19:55:34.180893 12409 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:34.181023 12409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:34.181371 12409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:34.184315 12409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "ba14a30397404b3590ead5193f52afa4"
format_stamp: "Formatted at 2026-08-07 19:55:34 on dist-test-slave-6bbx"
server_key: "74c43872d88018cbccdd645b50c1325b"
server_key_iv: "1f63966eff8cea2fa347d4487f9e8d69"
server_key_version: "encryptionkey@0"
I20260807 19:55:34.185060 12409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "ba14a30397404b3590ead5193f52afa4"
format_stamp: "Formatted at 2026-08-07 19:55:34 on dist-test-slave-6bbx"
server_key: "74c43872d88018cbccdd645b50c1325b"
server_key_iv: "1f63966eff8cea2fa347d4487f9e8d69"
server_key_version: "encryptionkey@0"
I20260807 19:55:34.190239 12409 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:34.193743 12425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:34.195091 12409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:34.195258 12409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "ba14a30397404b3590ead5193f52afa4"
format_stamp: "Formatted at 2026-08-07 19:55:34 on dist-test-slave-6bbx"
server_key: "74c43872d88018cbccdd645b50c1325b"
server_key_iv: "1f63966eff8cea2fa347d4487f9e8d69"
server_key_version: "encryptionkey@0"
I20260807 19:55:34.195492 12409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:34.201243 12409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:34.202047 12409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:34.202312 12409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:34.203274 12409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:34.204792 12409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:34.204903 12409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:34.205014 12409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:34.205092 12409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:34.238408 12409 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:39379
I20260807 19:55:34.238468 12578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:39379 every 8 connection(s)
I20260807 19:55:34.239722 12409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:34.240075 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 12409
I20260807 19:55:34.240280 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:34.241102 5910 external_mini_cluster.cc:1428] Setting key 5eee1258f2aa32e1e6f74e717aeb1871
I20260807 19:55:34.244436 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45291
--builtin_ntp_servers=127.5.197.148:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 19:55:34.249397 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:34.242442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:59983 (local address 127.5.197.190:45291)
0807 19:55:34.242932 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:34.242939 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:34.245274 (+ 2335us) server_negotiation.cc:407] Connection header received
0807 19:55:34.247027 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:34.247033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:34.247106 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:34.247202 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:34.248625 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:34.248632 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:34.248637 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:34.248658 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:34.248702 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:34.248714 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:34.248838 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:34.249026 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 19:55:34.249100 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":239,"threads_started":1}
I20260807 19:55:34.250448 12582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:34.244072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45291 (local address 127.5.197.129:59983)
0807 19:55:34.245123 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:34.245160 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:34.246755 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:34.247476 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:34.247485 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:34.247581 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:34.248307 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:34.248310 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:34.248362 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:34.248449 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:34.248808 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:34.248819 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:34.248827 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 19:55:34.249100 (+ 273us) client_negotiation.cc:240] Negotiation successful
0807 19:55:34.249386 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":322,"threads_started":1}
I20260807 19:55:34.252048 12579 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45291
I20260807 19:55:34.252345 12579 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:34.252948 12579 heartbeater.cc:511] Master 127.5.197.190:45291 requested a full tablet report, sending...
I20260807 19:55:34.255092 12333 ts_manager.cc:194] Registered new tserver with Master: ba14a30397404b3590ead5193f52afa4 (127.5.197.129:39379)
W20260807 19:55:34.588195 12584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:34.588510 12584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:34.588649 12584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:34.596041 12584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:34.596160 12584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:34.596323 12584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:34.605967 12584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:34.607353 12584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:34.609316 12584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:34.622655 12591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:34.622750 12590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:34.622732 12593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:34.623481 12584 server_base.cc:1034] running on GCE node
I20260807 19:55:34.624168 12584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:34.625168 12584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:34.626391 12584 hybrid_clock.cc:648] HybridClock initialized: now 1786132534626325 us; error 54 us; skew 500 ppm
I20260807 19:55:34.626726 12584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:34.629107 12584 webserver.cc:460] Webserver started at http://127.5.197.130:44385/ using document root <none> and password file <none>
I20260807 19:55:34.629817 12584 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:34.629922 12584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:34.630249 12584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:34.633313 12584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "3b62251c02b14d77beaa965f4e15566a"
format_stamp: "Formatted at 2026-08-07 19:55:34 on dist-test-slave-6bbx"
server_key: "9cd0802436eef976a95fdd1ab014c8de"
server_key_iv: "42b5770d5e885ef90134206ac8ca9b30"
server_key_version: "encryptionkey@0"
I20260807 19:55:34.634114 12584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "3b62251c02b14d77beaa965f4e15566a"
format_stamp: "Formatted at 2026-08-07 19:55:34 on dist-test-slave-6bbx"
server_key: "9cd0802436eef976a95fdd1ab014c8de"
server_key_iv: "42b5770d5e885ef90134206ac8ca9b30"
server_key_version: "encryptionkey@0"
I20260807 19:55:34.639803 12584 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 19:55:34.643457 12599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:34.644892 12584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:34.645061 12584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "3b62251c02b14d77beaa965f4e15566a"
format_stamp: "Formatted at 2026-08-07 19:55:34 on dist-test-slave-6bbx"
server_key: "9cd0802436eef976a95fdd1ab014c8de"
server_key_iv: "42b5770d5e885ef90134206ac8ca9b30"
server_key_version: "encryptionkey@0"
I20260807 19:55:34.645326 12584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:34.651032 12584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:34.651907 12584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:34.652158 12584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:34.653106 12584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:34.654508 12584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:34.654605 12584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:34.654713 12584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:34.654783 12584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:34.687327 12584 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:44789
I20260807 19:55:34.687342 12758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:44789 every 8 connection(s)
I20260807 19:55:34.688798 12584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:34.691028 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 12584
I20260807 19:55:34.691239 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:34.691879 5910 external_mini_cluster.cc:1428] Setting key b6faaa0e1cc4d35c8375f7309a3ee2f4
I20260807 19:55:34.694811 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45291
--builtin_ntp_servers=127.5.197.148:44011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 19:55:34.698689 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:34.691596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:51419 (local address 127.5.197.190:45291)
0807 19:55:34.691811 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:34.691816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:34.693763 (+ 1947us) server_negotiation.cc:407] Connection header received
0807 19:55:34.696149 (+ 2386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:34.696155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:34.696228 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:34.696336 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:34.697945 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:34.697950 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:34.697955 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:34.697975 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:34.698015 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:34.698030 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:34.698147 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:34.698342 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 19:55:34.698406 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 19:55:34.699911 12762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:34.692433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45291 (local address 127.5.197.130:51419)
0807 19:55:34.693596 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:34.693644 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:34.695803 (+ 2159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:34.696620 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:34.696632 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:34.696780 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:34.697555 (+ 775us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:34.697559 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:34.697612 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:34.697731 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:34.698131 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:34.698142 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:34.698149 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 19:55:34.698417 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 19:55:34.698675 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":357,"threads_started":1}
I20260807 19:55:34.701567 12760 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45291
I20260807 19:55:34.701915 12760 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:34.702633 12760 heartbeater.cc:511] Master 127.5.197.190:45291 requested a full tablet report, sending...
I20260807 19:55:34.704314 12333 ts_manager.cc:194] Registered new tserver with Master: 3b62251c02b14d77beaa965f4e15566a (127.5.197.130:44789)
W20260807 19:55:35.039904 12764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:35.040205 12764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:35.040304 12764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:35.047689 12764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:35.047812 12764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:35.047926 12764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:35.057384 12764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:35.058705 12764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:35.060536 12764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:35.073556 12772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:35.073516 12773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:35.073592 12776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:35.074539 12764 server_base.cc:1034] running on GCE node
I20260807 19:55:35.075228 12764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:35.076439 12764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:35.077633 12764 hybrid_clock.cc:648] HybridClock initialized: now 1786132535077563 us; error 61 us; skew 500 ppm
I20260807 19:55:35.078043 12764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:35.080926 12764 webserver.cc:460] Webserver started at http://127.5.197.131:33641/ using document root <none> and password file <none>
I20260807 19:55:35.081741 12764 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:35.081837 12764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:35.082129 12764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:35.085162 12764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "2979271f44754adea36ff6e8429c03aa"
format_stamp: "Formatted at 2026-08-07 19:55:35 on dist-test-slave-6bbx"
server_key: "747d5c0dfac9f54a11936859ae05c5ab"
server_key_iv: "6d0d76adcdcfbb891dad85df05e3803f"
server_key_version: "encryptionkey@0"
I20260807 19:55:35.085937 12764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "2979271f44754adea36ff6e8429c03aa"
format_stamp: "Formatted at 2026-08-07 19:55:35 on dist-test-slave-6bbx"
server_key: "747d5c0dfac9f54a11936859ae05c5ab"
server_key_iv: "6d0d76adcdcfbb891dad85df05e3803f"
server_key_version: "encryptionkey@0"
I20260807 19:55:35.091239 12764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 19:55:35.094856 12782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:35.096264 12764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:35.096427 12764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "2979271f44754adea36ff6e8429c03aa"
format_stamp: "Formatted at 2026-08-07 19:55:35 on dist-test-slave-6bbx"
server_key: "747d5c0dfac9f54a11936859ae05c5ab"
server_key_iv: "6d0d76adcdcfbb891dad85df05e3803f"
server_key_version: "encryptionkey@0"
I20260807 19:55:35.096676 12764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:35.102403 12764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:35.103211 12764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:35.103464 12764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:35.104492 12764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:35.105949 12764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:35.106048 12764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:35.106161 12764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:35.106233 12764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:35.136677 12764 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:36523
I20260807 19:55:35.136724 12933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:36523 every 8 connection(s)
I20260807 19:55:35.138083 12764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:35.145512 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 12764
I20260807 19:55:35.145691 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:35.146119 5910 external_mini_cluster.cc:1428] Setting key 5e577627d0e3df603bb94273842fef81
I20260807 19:55:35.146449 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.140764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:42269 (local address 127.5.197.190:45291)
0807 19:55:35.140975 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.140981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.142467 (+ 1486us) server_negotiation.cc:407] Connection header received
0807 19:55:35.144226 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.144237 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.144296 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.144378 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.145679 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.145685 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.145690 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.145712 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.145752 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.145766 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.145889 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.146070 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.146143 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 19:55:35.147645 12936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.141322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45291 (local address 127.5.197.131:42269)
0807 19:55:35.142295 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.142339 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:35.143938 (+ 1599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:35.144606 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:35.144614 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:35.144719 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:35.145361 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:35.145363 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:35.145403 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:35.145493 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:35.145854 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:35.145865 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:35.145874 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 19:55:35.146144 (+ 270us) client_negotiation.cc:240] Negotiation successful
0807 19:55:35.146410 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":301,"threads_started":1}
I20260807 19:55:35.149184 12934 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45291
I20260807 19:55:35.149534 12934 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:35.150218 12934 heartbeater.cc:511] Master 127.5.197.190:45291 requested a full tablet report, sending...
I20260807 19:55:35.151578 12333 ts_manager.cc:194] Registered new tserver with Master: 2979271f44754adea36ff6e8429c03aa (127.5.197.131:36523)
I20260807 19:55:35.161976 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:55:35.168979 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.166604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.5.197.190:45291)
0807 19:55:35.166802 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.166807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.167293 (+ 486us) server_negotiation.cc:407] Connection header received
0807 19:55:35.167439 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.167443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.167498 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.167581 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.168516 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.168521 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.168524 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.168537 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.168567 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.168578 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.168675 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.168717 (+ 42us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.168773 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:55:35.173178 12333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:35.180070 12333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:35.212598 12953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.191944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:36523 (local address 127.0.0.1:51926)
0807 19:55:35.203942 (+ 11998us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.204006 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:35.204169 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:35.208922 (+ 4753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:35.208930 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:35.209016 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:35.210056 (+ 1040us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:35.210059 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:35.210077 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:35.210127 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:35.211802 (+ 1675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:35.211813 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:35.211821 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 19:55:35.211986 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 19:55:35.212081 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11678,"thread_start_us":15660,"threads_started":1}
I20260807 19:55:35.213063 12958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.205502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55738 (local address 127.5.197.130:44789)
0807 19:55:35.208712 (+ 3210us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.208720 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.208749 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:55:35.208832 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.208840 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.209044 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.209210 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.210821 (+ 1611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.210830 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.210845 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.210868 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.210940 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.210969 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.211103 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.212418 (+ 1315us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.212597 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2937,"thread_start_us":2814,"threads_started":1}
I20260807 19:55:35.213495 12956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.192399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49444 (local address 127.5.197.129:39379)
0807 19:55:35.209014 (+ 16615us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.209020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.209044 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:55:35.209100 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.209105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.209314 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.209464 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.211478 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.211486 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.211499 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.211520 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.211582 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.211603 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.211788 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.213090 (+ 1302us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.213195 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16471,"thread_start_us":16341,"threads_started":1}
I20260807 19:55:35.213508 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.192158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49444)
0807 19:55:35.207379 (+ 15221us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.207404 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:35.207521 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:35.210302 (+ 2781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:35.210306 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:35.210328 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:35.211230 (+ 902us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:35.211234 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:35.211248 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:35.211289 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:35.211839 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:35.211843 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:35.211847 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 19:55:35.212453 (+ 606us) client_negotiation.cc:240] Negotiation successful
0807 19:55:35.212505 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15056,"thread_start_us":12164,"threads_started":1}
I20260807 19:55:35.213776 12952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.205242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:44789 (local address 127.0.0.1:55738)
0807 19:55:35.207573 (+ 2331us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.207598 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:35.207718 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:35.209220 (+ 1502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:35.209225 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:35.209247 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:35.209962 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:35.209964 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:35.210017 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:35.210098 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:35.211959 (+ 1861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:35.211967 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:35.211971 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 19:55:35.212092 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 19:55:35.212129 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2207,"thread_start_us":1774,"threads_started":1}
I20260807 19:55:35.214989 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.192245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51926 (local address 127.5.197.131:36523)
0807 19:55:35.208313 (+ 16068us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.208324 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.208362 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:55:35.208439 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.208447 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.208696 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.210308 (+ 1612us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.211565 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.211573 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.211583 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.211598 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.211641 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.211660 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.214229 (+ 2569us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.214330 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.214475 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15886,"thread_start_us":15722,"threads_started":1}
I20260807 19:55:35.218878 12491 tablet_service.cc:1467] Processing CreateTablet for tablet 89f4a3aa714f44f3baf15658c50ae151 (DEFAULT_TABLE table=test-table [id=b04222cda94e4228b2baa52b1bf5def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:35.218878 12667 tablet_service.cc:1467] Processing CreateTablet for tablet 89f4a3aa714f44f3baf15658c50ae151 (DEFAULT_TABLE table=test-table [id=b04222cda94e4228b2baa52b1bf5def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:35.220404 12667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f4a3aa714f44f3baf15658c50ae151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:35.220404 12491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f4a3aa714f44f3baf15658c50ae151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:35.219082 12843 tablet_service.cc:1467] Processing CreateTablet for tablet 89f4a3aa714f44f3baf15658c50ae151 (DEFAULT_TABLE table=test-table [id=b04222cda94e4228b2baa52b1bf5def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:35.221741 12843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f4a3aa714f44f3baf15658c50ae151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:35.232815 12959 tablet_bootstrap.cc:492] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Bootstrap starting.
I20260807 19:55:35.235064 12960 tablet_bootstrap.cc:492] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4: Bootstrap starting.
I20260807 19:55:35.236334 12959 tablet_bootstrap.cc:654] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:35.237013 12961 tablet_bootstrap.cc:492] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Bootstrap starting.
I20260807 19:55:35.238765 12960 tablet_bootstrap.cc:654] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:35.238839 12959 log.cc:824] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:35.240187 12960 log.cc:824] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:35.240815 12961 tablet_bootstrap.cc:654] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:35.241904 12961 log.cc:824] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:35.247979 12959 tablet_bootstrap.cc:492] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: No bootstrap required, opened a new log
I20260807 19:55:35.248242 12959 ts_tablet_manager.cc:1397] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.007s
I20260807 19:55:35.254452 12960 tablet_bootstrap.cc:492] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4: No bootstrap required, opened a new log
I20260807 19:55:35.254745 12960 ts_tablet_manager.cc:1397] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.008s
I20260807 19:55:35.257881 12961 tablet_bootstrap.cc:492] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: No bootstrap required, opened a new log
I20260807 19:55:35.258128 12961 ts_tablet_manager.cc:1397] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.007s
I20260807 19:55:35.258356 12579 heartbeater.cc:503] Master 127.5.197.190:45291 was elected leader, sending a full tablet report...
I20260807 19:55:35.258580 12959 raft_consensus.cc:348] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.259011 12959 raft_consensus.cc:374] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:35.259109 12959 raft_consensus.cc:729] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2979271f44754adea36ff6e8429c03aa, State: Initialized, Role: FOLLOWER
I20260807 19:55:35.259734 12959 consensus_queue.cc:260] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.266253 12961 raft_consensus.cc:348] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.266592 12961 raft_consensus.cc:374] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:35.266697 12961 raft_consensus.cc:729] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b62251c02b14d77beaa965f4e15566a, State: Initialized, Role: FOLLOWER
I20260807 19:55:35.267253 12961 consensus_queue.cc:260] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.268397 12960 raft_consensus.cc:348] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.268831 12960 raft_consensus.cc:374] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:35.268921 12960 raft_consensus.cc:729] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba14a30397404b3590ead5193f52afa4, State: Initialized, Role: FOLLOWER
I20260807 19:55:35.268919 12934 heartbeater.cc:503] Master 127.5.197.190:45291 was elected leader, sending a full tablet report...
I20260807 19:55:35.269687 12959 ts_tablet_manager.cc:1428] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Time spent starting tablet: real 0.021s user 0.019s sys 0.000s
I20260807 19:55:35.269577 12960 consensus_queue.cc:260] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.270730 12760 heartbeater.cc:503] Master 127.5.197.190:45291 was elected leader, sending a full tablet report...
I20260807 19:55:35.271210 12961 ts_tablet_manager.cc:1428] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Time spent starting tablet: real 0.013s user 0.002s sys 0.010s
I20260807 19:55:35.271616 12960 ts_tablet_manager.cc:1428] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
W20260807 19:55:35.389792 12935 tablet.cc:2369] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:35.419229 12969 raft_consensus.cc:482] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:35.419523 12969 raft_consensus.cc:504] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.421231 12969 leader_election.cc:288] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2979271f44754adea36ff6e8429c03aa (127.5.197.131:36523), 3b62251c02b14d77beaa965f4e15566a (127.5.197.130:44789)
I20260807 19:55:35.424614 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.421738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:54591 (local address 127.5.197.131:36523)
0807 19:55:35.421927 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.421933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.422544 (+ 611us) server_negotiation.cc:407] Connection header received
0807 19:55:35.422714 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.422719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.422780 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.422870 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.424002 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.424008 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.424013 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.424032 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.424071 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.424087 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.424211 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.424288 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.424349 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 19:55:35.424633 12958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.421759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:56549 (local address 127.5.197.130:44789)
0807 19:55:35.422065 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.422071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.422548 (+ 477us) server_negotiation.cc:407] Connection header received
0807 19:55:35.422699 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.422704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.422769 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.422870 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.424002 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.424008 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.424013 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.424032 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.424071 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.424087 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.424204 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.424340 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.424395 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260807 19:55:35.424866 12970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.421510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:36523 (local address 127.5.197.129:54591)
0807 19:55:35.422410 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.422431 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:35.422610 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:35.422919 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:35.422925 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:35.422950 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:35.423820 (+ 870us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:35.423823 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:35.423834 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:35.423862 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:35.424177 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:35.424182 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:35.424187 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 19:55:35.424322 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 19:55:35.424385 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"spinlock_wait_cycles":22784,"thread_start_us":492,"threads_started":1}
I20260807 19:55:35.425137 12972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.421654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:44789 (local address 127.5.197.129:56549)
0807 19:55:35.422451 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.422472 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:35.422570 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:35.422919 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:35.422925 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:35.422950 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:35.423768 (+ 818us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:55:35.423771 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:35.423795 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:55:35.423847 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:35.424177 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:35.424182 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:35.424187 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 19:55:35.424371 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 19:55:35.424406 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":489,"threads_started":1}
I20260807 19:55:35.425874 12868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f4a3aa714f44f3baf15658c50ae151" candidate_uuid: "ba14a30397404b3590ead5193f52afa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2979271f44754adea36ff6e8429c03aa" is_pre_election: true
I20260807 19:55:35.426170 12695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f4a3aa714f44f3baf15658c50ae151" candidate_uuid: "ba14a30397404b3590ead5193f52afa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b62251c02b14d77beaa965f4e15566a" is_pre_election: true
I20260807 19:55:35.426461 12868 raft_consensus.cc:2454] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba14a30397404b3590ead5193f52afa4 in term 0.
I20260807 19:55:35.426698 12695 raft_consensus.cc:2454] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba14a30397404b3590ead5193f52afa4 in term 0.
I20260807 19:55:35.427227 12426 leader_election.cc:302] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2979271f44754adea36ff6e8429c03aa, ba14a30397404b3590ead5193f52afa4; no voters:
I20260807 19:55:35.427608 12969 raft_consensus.cc:2781] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:35.427771 12969 raft_consensus.cc:482] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:35.427881 12969 raft_consensus.cc:3037] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:35.430007 12969 raft_consensus.cc:504] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
I20260807 19:55:35.430579 12969 leader_election.cc:288] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [CANDIDATE]: Term 1 election: Requested vote from peers 2979271f44754adea36ff6e8429c03aa (127.5.197.131:36523), 3b62251c02b14d77beaa965f4e15566a (127.5.197.130:44789)
I20260807 19:55:35.431041 12868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f4a3aa714f44f3baf15658c50ae151" candidate_uuid: "ba14a30397404b3590ead5193f52afa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2979271f44754adea36ff6e8429c03aa"
I20260807 19:55:35.431043 12695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f4a3aa714f44f3baf15658c50ae151" candidate_uuid: "ba14a30397404b3590ead5193f52afa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b62251c02b14d77beaa965f4e15566a"
I20260807 19:55:35.431244 12695 raft_consensus.cc:3037] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:35.431300 12868 raft_consensus.cc:3037] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:35.434478 12868 raft_consensus.cc:2454] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba14a30397404b3590ead5193f52afa4 in term 1.
I20260807 19:55:35.434478 12695 raft_consensus.cc:2454] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba14a30397404b3590ead5193f52afa4 in term 1.
I20260807 19:55:35.434855 12427 leader_election.cc:302] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b62251c02b14d77beaa965f4e15566a, ba14a30397404b3590ead5193f52afa4; no voters:
I20260807 19:55:35.435113 12969 raft_consensus.cc:2781] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:35.435537 12969 raft_consensus.cc:686] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 1 LEADER]: Becoming Leader. State: Replica: ba14a30397404b3590ead5193f52afa4, State: Running, Role: LEADER
I20260807 19:55:35.436003 12969 consensus_queue.cc:237] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } }
W20260807 19:55:35.440779 12761 tablet.cc:2369] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:35.440801 12333 catalog_manager.cc:5495] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba14a30397404b3590ead5193f52afa4 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "ba14a30397404b3590ead5193f52afa4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba14a30397404b3590ead5193f52afa4" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:35.459487 12956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.453382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49454 (local address 127.5.197.129:39379)
0807 19:55:35.453539 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.453544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.453695 (+ 151us) server_negotiation.cc:407] Connection header received
0807 19:55:35.453915 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.453919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.453993 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.454080 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.459028 (+ 4948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.459033 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.459036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.459051 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.459082 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.459094 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.459177 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.459242 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.459286 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 19:55:35.466941 12695 raft_consensus.cc:1261] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 1 FOLLOWER]: Refusing update from remote peer ba14a30397404b3590ead5193f52afa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:35.466977 12868 raft_consensus.cc:1261] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 1 FOLLOWER]: Refusing update from remote peer ba14a30397404b3590ead5193f52afa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:35.467809 12969 consensus_queue.cc:1035] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2979271f44754adea36ff6e8429c03aa" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:35.468070 12973 consensus_queue.cc:1035] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b62251c02b14d77beaa965f4e15566a" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 44789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:35.478018 12977 mvcc.cc:205] Tried to move back new op lower bound from 7315998865264164864 to 7315998865149607936. Current Snapshot: MvccSnapshot[applied={T|T < 7315998865264164864}]
I20260807 19:55:35.480392 12982 mvcc.cc:205] Tried to move back new op lower bound from 7315998865264164864 to 7315998865149607936. Current Snapshot: MvccSnapshot[applied={T|T < 7315998865264164864}]
I20260807 19:55:35.489615 12333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:35.489920 12333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:35.493547 12333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6184802eb2164dbf88ae738ff1dff16f: Sending DeleteTablet for 3 replicas of tablet 89f4a3aa714f44f3baf15658c50ae151
I20260807 19:55:35.494539 12843 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f4a3aa714f44f3baf15658c50ae151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:35 UTC) from {username='slave'} at 127.0.0.1:51926
I20260807 19:55:35.494649 12667 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f4a3aa714f44f3baf15658c50ae151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:35 UTC) from {username='slave'} at 127.0.0.1:55738
I20260807 19:55:35.494760 12491 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f4a3aa714f44f3baf15658c50ae151 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:35 UTC) from {username='slave'} at 127.0.0.1:49444
I20260807 19:55:35.496841 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 12409
I20260807 19:55:35.511601 12996 tablet_replica.cc:330] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: stopping tablet replica
I20260807 19:55:35.512056 12996 raft_consensus.cc:2229] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:35.512539 12996 raft_consensus.cc:2258] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:35.516353 12995 tablet_replica.cc:330] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: stopping tablet replica
I20260807 19:55:35.516387 12996 ts_tablet_manager.cc:1905] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:35.516881 12995 raft_consensus.cc:2229] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:35.517442 12995 raft_consensus.cc:2258] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:35.518195 12956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.498102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49456 (local address 127.5.197.129:39379)
0807 19:55:35.498277 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.498283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.515651 (+ 17368us) server_negotiation.cc:407] Connection header received
0807 19:55:35.515922 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.515928 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.516005 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.516120 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.517327 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.517333 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.517338 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.517360 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.517401 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.517417 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.517519 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.517786 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.517859 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:55:35.518460 12997 tablet_replica.cc:330] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4: stopping tablet replica
I20260807 19:55:35.519011 12997 raft_consensus.cc:2229] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:35.519825 12997 raft_consensus.cc:2258] T 89f4a3aa714f44f3baf15658c50ae151 P ba14a30397404b3590ead5193f52afa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:35.520026 12995 ts_tablet_manager.cc:1905] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:35.520118 12573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:35.525496 12996 ts_tablet_manager.cc:1918] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:35.525684 12996 log.cc:1196] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/89f4a3aa714f44f3baf15658c50ae151
I20260807 19:55:35.526198 12996 ts_tablet_manager.cc:1939] T 89f4a3aa714f44f3baf15658c50ae151 P 3b62251c02b14d77beaa965f4e15566a: Deleting consensus metadata
I20260807 19:55:35.528151 12312 catalog_manager.cc:4841] TS 3b62251c02b14d77beaa965f4e15566a (127.5.197.130:44789): tablet 89f4a3aa714f44f3baf15658c50ae151 (table test-table [id=b04222cda94e4228b2baa52b1bf5def7]) successfully deleted
I20260807 19:55:35.528203 12995 ts_tablet_manager.cc:1918] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:35.528367 12995 log.cc:1196] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/89f4a3aa714f44f3baf15658c50ae151
I20260807 19:55:35.528777 12995 ts_tablet_manager.cc:1939] T 89f4a3aa714f44f3baf15658c50ae151 P 2979271f44754adea36ff6e8429c03aa: Deleting consensus metadata
I20260807 19:55:35.530212 12311 catalog_manager.cc:4841] TS 2979271f44754adea36ff6e8429c03aa (127.5.197.131:36523): tablet 89f4a3aa714f44f3baf15658c50ae151 (table test-table [id=b04222cda94e4228b2baa52b1bf5def7]) successfully deleted
I20260807 19:55:35.618115 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 12409
I20260807 19:55:35.642107 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 12584
W20260807 19:55:35.642107 12312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.197.129:39379 (error 108)
I20260807 19:55:35.644326 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.643756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49472)
0807 19:55:35.643927 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.644143 (+ 216us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 19:55:35.644593 12312 catalog_manager.cc:4584] TS ba14a30397404b3590ead5193f52afa4 (127.5.197.129:39379): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 89f4a3aa714f44f3baf15658c50ae151: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
I20260807 19:55:35.645298 12958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.642991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55748 (local address 127.5.197.130:44789)
0807 19:55:35.643184 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.643202 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.643227 (+ 25us) server_negotiation.cc:407] Connection header received
0807 19:55:35.643416 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.643421 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.643543 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.643644 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.644630 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.644635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.644638 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.644653 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.644683 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.644696 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.644797 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.644917 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.644980 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:55:35.645974 12752 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:35.698565 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.698082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49480)
0807 19:55:35.698307 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.698397 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 19:55:35.699595 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.699254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49486)
0807 19:55:35.699400 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.699479 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 19:55:35.744138 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 12584
I20260807 19:55:35.760083 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.759599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49494)
0807 19:55:35.759833 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.759931 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260807 19:55:35.761274 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.760897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49504)
0807 19:55:35.761065 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.761142 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 19:55:35.769361 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 12764
I20260807 19:55:35.771975 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.770116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51934 (local address 127.5.197.131:36523)
0807 19:55:35.770288 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:35.770293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:35.770311 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:55:35.770473 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:35.770477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:35.770578 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:35.770662 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:35.771471 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:35.771475 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:35.771478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:35.771491 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:35.771517 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:35.771528 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:35.771624 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:35.771690 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 19:55:35.771753 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 19:55:35.772630 12928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:35.842548 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.842034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49512)
0807 19:55:35.842254 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.842363 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 19:55:35.843693 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:35.843273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39379 (local address 127.0.0.1:49514)
0807 19:55:35.843466 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:35.843538 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260807 19:55:35.861321 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 12764
I20260807 19:55:35.884234 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 12291
I20260807 19:55:35.885535 12373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:35.993196 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 12291
2026-08-07T19:55:36Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2787 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 19:55:36.044183 5910 mini_oidc.cc:152] Starting JWKS server
I20260807 19:55:36.047128 5910 webserver.cc:460] Webserver started at https://127.0.0.1:43037/ using document root <none> and password file <none>
I20260807 19:55:36.047462 5910 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 19:55:36.048158 5910 webserver.cc:460] Webserver started at http://127.0.0.1:43701/ using document root <none> and password file <none>
2026-08-07T19:55:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:36Z Disabled control of system clock
I20260807 19:55:36.082763 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40149
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:40397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:40149
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43037/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/testchainca.cert with env {}
W20260807 19:55:36.416277 13011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:36.416602 13011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:36.416740 13011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:36.424099 13011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:36.424232 13011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:36.424311 13011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:36.424396 13011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:36.424456 13011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:55:36.424542 13011 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:55:36.424597 13011 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43037/jwks.json
I20260807 19:55:36.434789 13011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:40397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:40149
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43037/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:36.436218 13011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:36.437608 13011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:36.449635 13018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:36.449599 13020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:36.449666 13022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:36.450729 13011 server_base.cc:1034] running on GCE node
I20260807 19:55:36.451519 13011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:36.452948 13011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:36.454145 13011 hybrid_clock.cc:648] HybridClock initialized: now 1786132536454093 us; error 45 us; skew 500 ppm
I20260807 19:55:36.454502 13011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:36.456817 13011 webserver.cc:460] Webserver started at http://127.5.197.190:37269/ using document root <none> and password file <none>
I20260807 19:55:36.457512 13011 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:36.457616 13011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:36.457935 13011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:36.460953 13011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "0e7c2d29b4204d8ba066e54cd6ebc355"
format_stamp: "Formatted at 2026-08-07 19:55:36 on dist-test-slave-6bbx"
server_key: "3da39f6a1e9609d137b41c7c125ac7c1"
server_key_iv: "eac591c146c754576c035b00fb5d69c7"
server_key_version: "encryptionkey@0"
I20260807 19:55:36.461742 13011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "0e7c2d29b4204d8ba066e54cd6ebc355"
format_stamp: "Formatted at 2026-08-07 19:55:36 on dist-test-slave-6bbx"
server_key: "3da39f6a1e9609d137b41c7c125ac7c1"
server_key_iv: "eac591c146c754576c035b00fb5d69c7"
server_key_version: "encryptionkey@0"
I20260807 19:55:36.467026 13011 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:55:36.470573 13028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:36.471947 13011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:36.472122 13011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "0e7c2d29b4204d8ba066e54cd6ebc355"
format_stamp: "Formatted at 2026-08-07 19:55:36 on dist-test-slave-6bbx"
server_key: "3da39f6a1e9609d137b41c7c125ac7c1"
server_key_iv: "eac591c146c754576c035b00fb5d69c7"
server_key_version: "encryptionkey@0"
I20260807 19:55:36.472334 13011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:36.490536 13011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:36.491389 13011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:36.491751 13011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:36.510207 13011 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:40149
I20260807 19:55:36.510221 13099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:40149 every 8 connection(s)
I20260807 19:55:36.511559 13011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:36.514640 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 13011
I20260807 19:55:36.514833 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:36.515450 13101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:36.515466 5910 external_mini_cluster.cc:1428] Setting key 1789b54034bc23fb1d9e36563870edeb
I20260807 19:55:36.530707 13109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:36.517359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41976 (local address 127.5.197.190:40149)
0807 19:55:36.518446 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:36.518466 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:36.518521 (+ 55us) server_negotiation.cc:407] Connection header received
0807 19:55:36.520477 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:36.520507 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:36.521101 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:36.521562 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:36.522109 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:36.524144 (+ 2035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:36.525474 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:36.526539 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:36.526737 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:36.527911 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:36.527922 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:36.527940 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:36.528701 (+ 761us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:36.528800 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:36.528826 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:36.528934 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:36.529126 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 19:55:36.529447 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":328,"threads_started":1}
I20260807 19:55:36.530951 13101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355: Bootstrap starting.
I20260807 19:55:36.534284 13101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:36.534423 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:55:36.535506 13101 log.cc:824] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:36.538331 13101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355: No bootstrap required, opened a new log
I20260807 19:55:36.545351 13101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40149 } }
I20260807 19:55:36.545681 13101 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:36.545765 13101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7c2d29b4204d8ba066e54cd6ebc355, State: Initialized, Role: FOLLOWER
I20260807 19:55:36.546247 13101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40149 } }
I20260807 19:55:36.546459 13101 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:36.546581 13101 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:36.546730 13101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:36.548979 13101 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40149 } }
I20260807 19:55:36.549446 13101 leader_election.cc:302] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e7c2d29b4204d8ba066e54cd6ebc355; no voters:
I20260807 19:55:36.550002 13101 leader_election.cc:288] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:36.550133 13115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:36.550791 13115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [term 1 LEADER]: Becoming Leader. State: Replica: 0e7c2d29b4204d8ba066e54cd6ebc355, State: Running, Role: LEADER
I20260807 19:55:36.551313 13115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40149 } }
I20260807 19:55:36.552045 13101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:36.553985 13118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e7c2d29b4204d8ba066e54cd6ebc355. Latest consensus state: current_term: 1 leader_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40149 } } }
I20260807 19:55:36.554740 13118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:36.554562 13117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e7c2d29b4204d8ba066e54cd6ebc355" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40149 } } }
I20260807 19:55:36.554872 13117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:36.560653 13126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:36.566260 13126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:36.575304 13126 catalog_manager.cc:1347] Generated new cluster ID: 5dcf71589f67457f90a7ee8f0bbc2b7e
I20260807 19:55:36.575446 13126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:36.590583 13126 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:36.592455 13126 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:36.604952 13126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e7c2d29b4204d8ba066e54cd6ebc355: Generated new TSK 0
I20260807 19:55:36.605868 13126 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 19:55:36.653990 13147 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 19:55:36.654196 13147 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 19:55:36.656399 13109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:36.632927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41986 (local address 127.5.197.190:40149)
0807 19:55:36.633124 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:36.633131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:36.633530 (+ 399us) server_negotiation.cc:407] Connection header received
0807 19:55:36.633906 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:36.633913 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:36.634024 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:36.634195 (+ 171us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:55:36.634716 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:36.635863 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:36.637347 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:36.638052 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:36.638189 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:36.638754 (+ 565us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:55:36.655640 (+ 16886us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43037/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 19:55:36.656066 (+ 426us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41986: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43037/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 19:55:36.656533 13109 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41986: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43037/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 19:55:36.657734 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:36.632752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:40149 (local address 127.0.0.1:41986)
0807 19:55:36.633426 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:36.633446 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:36.633606 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:36.634208 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:36.634212 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:36.634249 (+ 37us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:55:36.634557 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:36.634566 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:36.636015 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:36.636019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:36.637194 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:36.637207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:36.638219 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:36.638241 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:36.638371 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:36.638431 (+ 60us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:55:36.656000 (+ 17569us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43037/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 19:55:36.656305 (+ 305us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.197.190:40149: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43037/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":315,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.5.197.190:40149: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43037/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 19:55:36.659509 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 13011
I20260807 19:55:36.660753 13094 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:36.755817 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 13011
2026-08-07T19:55:36Z chronyd exiting
I20260807 19:55:36.815074 5910 test_util.cc:175] -----------------------------------------------
I20260807 19:55:36.815204 5910 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132491354022-5910-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (777 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 19:55:36.819175 5910 mini_oidc.cc:152] Starting JWKS server
I20260807 19:55:36.821118 5910 webserver.cc:460] Webserver started at https://127.0.0.1:40283/ using document root <none> and password file <none>
I20260807 19:55:36.821368 5910 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 19:55:36.822063 5910 webserver.cc:460] Webserver started at http://127.0.0.1:44225/ using document root <none> and password file <none>
2026-08-07T19:55:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:36Z Disabled control of system clock
I20260807 19:55:36.857214 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37053
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:44745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37053
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40283/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/testchainca.cert with env {}
W20260807 19:55:37.186111 13155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:37.186444 13155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:37.186578 13155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:37.193892 13155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:37.194010 13155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:37.194077 13155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:37.194164 13155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:37.194223 13155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:55:37.194317 13155 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:55:37.194370 13155 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40283/jwks.json
I20260807 19:55:37.204530 13155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37053
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40283/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:37.205863 13155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:37.207243 13155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:37.218475 13165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:37.218519 13170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:37.218550 13166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:37.219573 13155 server_base.cc:1034] running on GCE node
I20260807 19:55:37.220322 13155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:37.221616 13155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:37.222817 13155 hybrid_clock.cc:648] HybridClock initialized: now 1786132537222769 us; error 39 us; skew 500 ppm
I20260807 19:55:37.223141 13155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:37.225396 13155 webserver.cc:460] Webserver started at http://127.5.197.190:44653/ using document root <none> and password file <none>
I20260807 19:55:37.226042 13155 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:37.226156 13155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:37.226468 13155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:37.229315 13155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "7980f803fb3a498fbd9ad2542944711a"
format_stamp: "Formatted at 2026-08-07 19:55:37 on dist-test-slave-6bbx"
server_key: "edc3865fa6369b024c94eb6a1c9f7fce"
server_key_iv: "6f511830d5bc8b7213fced3811d50d2c"
server_key_version: "encryptionkey@0"
I20260807 19:55:37.230079 13155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "7980f803fb3a498fbd9ad2542944711a"
format_stamp: "Formatted at 2026-08-07 19:55:37 on dist-test-slave-6bbx"
server_key: "edc3865fa6369b024c94eb6a1c9f7fce"
server_key_iv: "6f511830d5bc8b7213fced3811d50d2c"
server_key_version: "encryptionkey@0"
I20260807 19:55:37.235015 13155 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:55:37.238437 13178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:37.239817 13155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:37.239976 13155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "7980f803fb3a498fbd9ad2542944711a"
format_stamp: "Formatted at 2026-08-07 19:55:37 on dist-test-slave-6bbx"
server_key: "edc3865fa6369b024c94eb6a1c9f7fce"
server_key_iv: "6f511830d5bc8b7213fced3811d50d2c"
server_key_version: "encryptionkey@0"
I20260807 19:55:37.240171 13155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:37.255106 13155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:37.255913 13155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:37.256196 13155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:37.273829 13155 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37053
I20260807 19:55:37.273852 13254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37053 every 8 connection(s)
I20260807 19:55:37.275135 13155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:37.278931 13255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:37.279541 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 13155
I20260807 19:55:37.279803 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:37.280654 5910 external_mini_cluster.cc:1428] Setting key c7e9ac758c1cb12866bec14036b555e4
I20260807 19:55:37.292659 13255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a: Bootstrap starting.
I20260807 19:55:37.294026 13260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:37.282589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34794 (local address 127.5.197.190:37053)
0807 19:55:37.283568 (+ 979us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:37.283578 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:37.283618 (+ 40us) server_negotiation.cc:407] Connection header received
0807 19:55:37.285448 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:37.285470 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:37.285917 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:37.286232 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:37.286803 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:37.288076 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:37.289849 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:37.290549 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:37.290718 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:37.291902 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:37.291909 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:37.291922 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:37.292401 (+ 479us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:37.292474 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:37.292500 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:37.292584 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:37.292851 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 19:55:37.293132 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":348,"threads_started":1}
I20260807 19:55:37.295881 13255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:37.297013 13255 log.cc:824] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:37.297562 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:55:37.299526 13255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a: No bootstrap required, opened a new log
I20260807 19:55:37.307292 13255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7980f803fb3a498fbd9ad2542944711a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37053 } }
I20260807 19:55:37.307812 13255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:37.307917 13255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7980f803fb3a498fbd9ad2542944711a, State: Initialized, Role: FOLLOWER
I20260807 19:55:37.308547 13255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7980f803fb3a498fbd9ad2542944711a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37053 } }
I20260807 19:55:37.308796 13255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:37.308928 13255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:37.309089 13255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:37.311285 13255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7980f803fb3a498fbd9ad2542944711a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37053 } }
I20260807 19:55:37.311847 13255 leader_election.cc:302] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7980f803fb3a498fbd9ad2542944711a; no voters:
I20260807 19:55:37.312474 13255 leader_election.cc:288] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:37.312598 13262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:37.313275 13262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [term 1 LEADER]: Becoming Leader. State: Replica: 7980f803fb3a498fbd9ad2542944711a, State: Running, Role: LEADER
I20260807 19:55:37.313843 13262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7980f803fb3a498fbd9ad2542944711a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37053 } }
I20260807 19:55:37.314577 13255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:37.316720 13265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7980f803fb3a498fbd9ad2542944711a. Latest consensus state: current_term: 1 leader_uuid: "7980f803fb3a498fbd9ad2542944711a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7980f803fb3a498fbd9ad2542944711a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37053 } } }
I20260807 19:55:37.317261 13265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:37.317669 13263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7980f803fb3a498fbd9ad2542944711a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7980f803fb3a498fbd9ad2542944711a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37053 } } }
I20260807 19:55:37.318013 13263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:37.318887 13272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:37.324256 13272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:37.333586 13272 catalog_manager.cc:1347] Generated new cluster ID: 3b33f5020da04300af3446b8d93a8e79
I20260807 19:55:37.333712 13272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:37.347627 13272 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:37.348937 13272 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:37.364517 13272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7980f803fb3a498fbd9ad2542944711a: Generated new TSK 0
I20260807 19:55:37.365674 13272 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 19:55:37.407735 13296 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 19:55:37.407882 13296 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 19:55:37.408979 13260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:37.389047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34806 (local address 127.5.197.190:37053)
0807 19:55:37.389268 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:37.389276 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:37.389709 (+ 433us) server_negotiation.cc:407] Connection header received
0807 19:55:37.389974 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:37.389979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:37.390061 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:37.390192 (+ 131us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:55:37.390744 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:37.391500 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:37.393575 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:37.394044 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:37.394161 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:37.394750 (+ 589us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:55:37.408407 (+ 13657us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40283/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 19:55:37.408742 (+ 335us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34806: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40283/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 19:55:37.409108 13260 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34806: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40283/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 19:55:37.409699 13295 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:37.388975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37053 (local address 127.0.0.1:34806)
0807 19:55:37.389595 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:37.389615 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:37.389791 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:37.390226 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:37.390231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:37.390246 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:55:37.390550 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:37.390562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:37.391649 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:37.391655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:37.393397 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:37.393414 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:37.394220 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:37.394227 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:37.394437 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:37.394484 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:55:37.408657 (+ 14173us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40283/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 19:55:37.408960 (+ 303us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.197.190:37053: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40283/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":313,"threads_started":1}
I20260807 19:55:37.410810 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 13155
I20260807 19:55:37.412207 13249 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:37.506249 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 13155
2026-08-07T19:55:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (748 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 19:55:37.567320 5910 mini_oidc.cc:152] Starting JWKS server
I20260807 19:55:37.569350 5910 webserver.cc:460] Webserver started at https://127.0.0.1:36623/ using document root <none> and password file <none>
I20260807 19:55:37.569555 5910 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 19:55:37.570406 5910 webserver.cc:460] Webserver started at http://127.0.0.1:41459/ using document root <none> and password file <none>
2026-08-07T19:55:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:37Z Disabled control of system clock
I20260807 19:55:37.607105 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40071
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:40071
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36623/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 19:55:37.953696 13307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:37.954015 13307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:37.954157 13307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:37.961266 13307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:37.961377 13307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:37.961442 13307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:37.961519 13307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:37.961580 13307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:55:37.961664 13307 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:55:37.961719 13307 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36623/jwks.json
I20260807 19:55:37.970893 13307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:40071
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36623/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:37.972252 13307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:37.974093 13307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:37.985601 13318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:37.985668 13316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:37.985811 13315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:37.986539 13307 server_base.cc:1034] running on GCE node
I20260807 19:55:37.987303 13307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:37.988652 13307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:37.989856 13307 hybrid_clock.cc:648] HybridClock initialized: now 1786132537989817 us; error 25 us; skew 500 ppm
I20260807 19:55:37.990181 13307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:37.992364 13307 webserver.cc:460] Webserver started at http://127.5.197.190:46733/ using document root <none> and password file <none>
I20260807 19:55:37.993011 13307 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:37.993111 13307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:37.993433 13307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:37.996261 13307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "cbde4c6b473e41008a3e176cdf1312ac"
format_stamp: "Formatted at 2026-08-07 19:55:37 on dist-test-slave-6bbx"
server_key: "6e3a504c309a6e6d94f055fdf7e3178f"
server_key_iv: "aea638940dea45123f846828db564de4"
server_key_version: "encryptionkey@0"
I20260807 19:55:37.997015 13307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "cbde4c6b473e41008a3e176cdf1312ac"
format_stamp: "Formatted at 2026-08-07 19:55:37 on dist-test-slave-6bbx"
server_key: "6e3a504c309a6e6d94f055fdf7e3178f"
server_key_iv: "aea638940dea45123f846828db564de4"
server_key_version: "encryptionkey@0"
I20260807 19:55:38.001901 13307 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:38.005306 13329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:38.006595 13307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:55:38.006762 13307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "cbde4c6b473e41008a3e176cdf1312ac"
format_stamp: "Formatted at 2026-08-07 19:55:37 on dist-test-slave-6bbx"
server_key: "6e3a504c309a6e6d94f055fdf7e3178f"
server_key_iv: "aea638940dea45123f846828db564de4"
server_key_version: "encryptionkey@0"
I20260807 19:55:38.006968 13307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:38.025569 13307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:38.026467 13307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:38.026782 13307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:38.044389 13307 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:40071
I20260807 19:55:38.044420 13397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:40071 every 8 connection(s)
I20260807 19:55:38.045686 13307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:38.049494 13399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:38.049499 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 13307
I20260807 19:55:38.049676 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:38.050519 5910 external_mini_cluster.cc:1428] Setting key 44107a661ab04447beda7fd7ddc93da5
I20260807 19:55:38.062959 13399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac: Bootstrap starting.
I20260807 19:55:38.064513 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:38.052456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56530 (local address 127.5.197.190:40071)
0807 19:55:38.053527 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:38.053538 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:38.053584 (+ 46us) server_negotiation.cc:407] Connection header received
0807 19:55:38.055697 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:38.055725 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:38.056185 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:38.056532 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:38.057085 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.058355 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.060186 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.060884 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.061017 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:38.062202 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:38.062210 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:38.062223 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:38.062744 (+ 521us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:38.062827 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:38.062849 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:38.062931 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:38.063192 (+ 261us) server_negotiation.cc:299] Negotiation successful
0807 19:55:38.063518 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":418,"threads_started":1}
I20260807 19:55:38.066220 13399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:38.067360 13399 log.cc:824] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:38.068049 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:55:38.070039 13399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac: No bootstrap required, opened a new log
I20260807 19:55:38.077344 13399 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbde4c6b473e41008a3e176cdf1312ac" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40071 } }
I20260807 19:55:38.077725 13399 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:38.077819 13399 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbde4c6b473e41008a3e176cdf1312ac, State: Initialized, Role: FOLLOWER
I20260807 19:55:38.078392 13399 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbde4c6b473e41008a3e176cdf1312ac" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40071 } }
I20260807 19:55:38.078613 13399 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:38.078739 13399 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:38.078902 13399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:38.081174 13399 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbde4c6b473e41008a3e176cdf1312ac" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40071 } }
I20260807 19:55:38.081629 13399 leader_election.cc:302] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbde4c6b473e41008a3e176cdf1312ac; no voters:
I20260807 19:55:38.082212 13399 leader_election.cc:288] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:38.082365 13406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:38.083082 13406 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [term 1 LEADER]: Becoming Leader. State: Replica: cbde4c6b473e41008a3e176cdf1312ac, State: Running, Role: LEADER
I20260807 19:55:38.083564 13406 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbde4c6b473e41008a3e176cdf1312ac" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40071 } }
I20260807 19:55:38.084300 13399 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:38.086299 13407 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbde4c6b473e41008a3e176cdf1312ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbde4c6b473e41008a3e176cdf1312ac" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40071 } } }
I20260807 19:55:38.086621 13408 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbde4c6b473e41008a3e176cdf1312ac. Latest consensus state: current_term: 1 leader_uuid: "cbde4c6b473e41008a3e176cdf1312ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbde4c6b473e41008a3e176cdf1312ac" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40071 } } }
I20260807 19:55:38.087220 13408 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:38.087226 13407 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:38.091010 13413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:38.096170 13413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:38.105739 13413 catalog_manager.cc:1347] Generated new cluster ID: d82ab85416d442b4a66f222acbf58d14
I20260807 19:55:38.105850 13413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:38.126047 13413 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:38.127321 13413 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:38.135181 13413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbde4c6b473e41008a3e176cdf1312ac: Generated new TSK 0
I20260807 19:55:38.136013 13413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:55:38.157769 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:38.150166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56538 (local address 127.5.197.190:40071)
0807 19:55:38.150325 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:38.150331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:38.150822 (+ 491us) server_negotiation.cc:407] Connection header received
0807 19:55:38.151043 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:38.151047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:38.151129 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:38.151276 (+ 147us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:55:38.151767 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.152524 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.153999 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.154480 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.154594 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:38.155159 (+ 565us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:55:38.157133 (+ 1974us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36623/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 19:55:38.157470 (+ 337us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56538: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36623/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 19:55:38.158012 13436 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:38.150129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:40071 (local address 127.0.0.1:56538)
0807 19:55:38.150709 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:38.150732 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:38.150880 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:38.151307 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:38.151312 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:38.151324 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:55:38.151592 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:38.151601 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.152670 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.152674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:38.153838 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:38.153852 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.154681 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.154687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:38.154837 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:38.154872 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:55:38.157348 (+ 2476us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36623/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 19:55:38.157606 (+ 258us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.197.190:40071: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36623/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":309,"threads_started":1}
W20260807 19:55:38.158350 13404 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56538: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36623/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260807 19:55:38.159107 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 13307
I20260807 19:55:38.160281 13393 generic_service.cc:196] Checking for leaks (request via RPC)
E20260807 19:55:38.170593 13437 webserver.cc:533] Webserver: sslize failed:
E20260807 19:55:38.170706 13437 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 19:55:38.254108 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 13307
2026-08-07T19:55:38Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (747 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T19:55:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:38Z Disabled control of system clock
I20260807 19:55:38.350399 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:42313
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:43389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:42313
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/testchainca.cert with env {}
W20260807 19:55:38.685240 13444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:38.685536 13444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:38.685654 13444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:38.692976 13444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:38.693084 13444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:38.693147 13444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:38.693223 13444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:38.693286 13444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:55:38.693351 13444 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:55:38.693408 13444 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 19:55:38.703528 13444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:43389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:42313
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:42313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:38.704885 13444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:38.706197 13444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:38.717932 13452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:38.717958 13449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:38.717958 13454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:38.718537 13444 server_base.cc:1034] running on GCE node
I20260807 19:55:38.719365 13444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:38.720808 13444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:38.722012 13444 hybrid_clock.cc:648] HybridClock initialized: now 1786132538721955 us; error 51 us; skew 500 ppm
I20260807 19:55:38.722371 13444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:55:38.724628 13444 webserver.cc:460] Webserver started at http://127.5.197.190:42093/ using document root <none> and password file <none>
I20260807 19:55:38.725389 13444 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:38.725498 13444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:38.725807 13444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:38.728814 13444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515"
format_stamp: "Formatted at 2026-08-07 19:55:38 on dist-test-slave-6bbx"
server_key: "5a2a0fdc0e6a42d53aa0e1e6eac26b2b"
server_key_iv: "250484a05ecd1fec23387c4a6524d0a2"
server_key_version: "encryptionkey@0"
I20260807 19:55:38.729594 13444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515"
format_stamp: "Formatted at 2026-08-07 19:55:38 on dist-test-slave-6bbx"
server_key: "5a2a0fdc0e6a42d53aa0e1e6eac26b2b"
server_key_iv: "250484a05ecd1fec23387c4a6524d0a2"
server_key_version: "encryptionkey@0"
I20260807 19:55:38.734637 13444 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:55:38.738101 13464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:38.739519 13444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:38.739711 13444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515"
format_stamp: "Formatted at 2026-08-07 19:55:38 on dist-test-slave-6bbx"
server_key: "5a2a0fdc0e6a42d53aa0e1e6eac26b2b"
server_key_iv: "250484a05ecd1fec23387c4a6524d0a2"
server_key_version: "encryptionkey@0"
I20260807 19:55:38.739938 13444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:38.755342 13444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:38.756188 13444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:38.756460 13444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:38.773820 13444 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:42313
I20260807 19:55:38.773840 13543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:42313 every 8 connection(s)
I20260807 19:55:38.775120 13444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:38.778965 13544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:38.782493 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 13444
I20260807 19:55:38.782712 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:38.783344 5910 external_mini_cluster.cc:1428] Setting key 700025f6244068ff108acbccc0e84101
I20260807 19:55:38.789987 13544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515: Bootstrap starting.
I20260807 19:55:38.793483 13544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:38.794720 13544 log.cc:824] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:38.797766 13549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:38.785290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54504 (local address 127.5.197.190:42313)
0807 19:55:38.786215 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:38.786229 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:38.786282 (+ 53us) server_negotiation.cc:407] Connection header received
0807 19:55:38.788564 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:38.788588 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:38.789024 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:38.789336 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:38.789931 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.791274 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.793075 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.793807 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.793956 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:38.795239 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:38.795256 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:38.795276 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:55:38.796051 (+ 775us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:38.796151 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:55:38.796179 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:38.796320 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:38.796506 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 19:55:38.796811 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":345,"threads_started":1}
I20260807 19:55:38.797886 13544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515: No bootstrap required, opened a new log
I20260807 19:55:38.801787 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:55:38.806185 13544 raft_consensus.cc:348] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42313 } }
I20260807 19:55:38.806538 13544 raft_consensus.cc:374] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:38.806638 13544 raft_consensus.cc:729] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309bc6bd5ab54f0a9eaee8b4c60dc515, State: Initialized, Role: FOLLOWER
I20260807 19:55:38.807206 13544 consensus_queue.cc:260] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42313 } }
I20260807 19:55:38.807441 13544 raft_consensus.cc:388] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:38.807572 13544 raft_consensus.cc:482] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:38.807791 13544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:38.809955 13544 raft_consensus.cc:504] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42313 } }
I20260807 19:55:38.810421 13544 leader_election.cc:302] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 309bc6bd5ab54f0a9eaee8b4c60dc515; no voters:
I20260807 19:55:38.811003 13544 leader_election.cc:288] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:38.811129 13551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:38.812350 13551 raft_consensus.cc:686] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [term 1 LEADER]: Becoming Leader. State: Replica: 309bc6bd5ab54f0a9eaee8b4c60dc515, State: Running, Role: LEADER
I20260807 19:55:38.812862 13551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42313 } }
I20260807 19:55:38.813143 13544 sys_catalog.cc:564] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:38.815867 13554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 309bc6bd5ab54f0a9eaee8b4c60dc515. Latest consensus state: current_term: 1 leader_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42313 } } }
I20260807 19:55:38.816313 13554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:38.816754 13552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "309bc6bd5ab54f0a9eaee8b4c60dc515" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42313 } } }
I20260807 19:55:38.817070 13552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:38.817800 13562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:38.822835 13562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:38.832196 13562 catalog_manager.cc:1347] Generated new cluster ID: 06cc540d1a064ff6b5d212634c57e174
I20260807 19:55:38.832321 13562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:38.860232 13562 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:38.862074 13562 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:38.869694 13562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 309bc6bd5ab54f0a9eaee8b4c60dc515: Generated new TSK 0
I20260807 19:55:38.870774 13562 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:55:38.907555 13549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:38.891328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54520 (local address 127.5.197.190:42313)
0807 19:55:38.891530 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:38.891536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:38.891892 (+ 356us) server_negotiation.cc:407] Connection header received
0807 19:55:38.892128 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:38.892132 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:38.892262 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:38.892396 (+ 134us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:55:38.892933 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.893698 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.895698 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.896134 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.896259 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:38.896781 (+ 522us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:55:38.906969 (+ 10188us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 19:55:38.907302 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54520: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 19:55:38.907749 13549 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54520: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 19:55:38.907979 13582 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:38.891090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:42313 (local address 127.0.0.1:54520)
0807 19:55:38.891789 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:38.891809 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:38.891965 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:38.892421 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:38.892426 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:38.892439 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:55:38.892785 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:38.892797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.893835 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.893841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:38.895543 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:38.895558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:38.896300 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:38.896307 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:38.896494 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:38.896539 (+ 45us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:55:38.907243 (+ 10704us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 19:55:38.907568 (+ 325us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.197.190:42313: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":343,"threads_started":1}
I20260807 19:55:38.909181 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 13444
I20260807 19:55:38.910349 13538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:39.006017 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 13444
2026-08-07T19:55:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (730 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (420 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (424 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:39 dist-test-slave-6bbx krb5kdc[13603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:39 dist-test-slave-6bbx krb5kdc[13603](info): set up 2 sockets
Aug 07 19:55:39 dist-test-slave-6bbx krb5kdc[13603](info): commencing operation
krb5kdc: starting...
W20260807 19:55:41.026597 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:41 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:55:41.247107 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34387
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:34387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:41.586411 13629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:41.586730 13629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:41.586841 13629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:41.594151 13629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:41.594280 13629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:41.594341 13629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:41.594425 13629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:41.594492 13629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:41.604553 13629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:34387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:41.605917 13629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:41.607286 13629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:41.619320 13639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:41.619356 13636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:41.619405 13635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:41.620119 13629 server_base.cc:1034] running on GCE node
I20260807 19:55:41.620947 13629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:41.622442 13629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:41.623692 13629 hybrid_clock.cc:648] HybridClock initialized: now 1786132541623625 us; error 32 us; skew 500 ppm
I20260807 19:55:41.624027 13629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:41 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132541, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:41.632004 13629 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:55:41.633651 13629 webserver.cc:460] Webserver started at http://127.5.197.190:44479/ using document root <none> and password file <none>
I20260807 19:55:41.634398 13629 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:41.634524 13629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:41.634843 13629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:41.638015 13629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "610cc0bdeca34668ad94388da7bfe848"
format_stamp: "Formatted at 2026-08-07 19:55:41 on dist-test-slave-6bbx"
server_key: "67bc0c5c63c24501185696b1570fcf6e"
server_key_iv: "370b0c070cd54a7cd045bc637eee277e"
server_key_version: "encryptionkey@0"
I20260807 19:55:41.638813 13629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "610cc0bdeca34668ad94388da7bfe848"
format_stamp: "Formatted at 2026-08-07 19:55:41 on dist-test-slave-6bbx"
server_key: "67bc0c5c63c24501185696b1570fcf6e"
server_key_iv: "370b0c070cd54a7cd045bc637eee277e"
server_key_version: "encryptionkey@0"
I20260807 19:55:41.644299 13629 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 19:55:41.648010 13648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:41.649443 13629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:41.649613 13629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "610cc0bdeca34668ad94388da7bfe848"
format_stamp: "Formatted at 2026-08-07 19:55:41 on dist-test-slave-6bbx"
server_key: "67bc0c5c63c24501185696b1570fcf6e"
server_key_iv: "370b0c070cd54a7cd045bc637eee277e"
server_key_version: "encryptionkey@0"
I20260807 19:55:41.649811 13629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:41.661868 13629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:41.666162 13629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:41.666458 13629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:41.684693 13629 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:34387
I20260807 19:55:41.684736 13712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:34387 every 8 connection(s)
I20260807 19:55:41.686112 13629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:41.690016 13715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:41.693783 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 13629
I20260807 19:55:41.693989 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:41.694621 5910 external_mini_cluster.cc:1428] Setting key 4d96267649e86f2b327cbc9b7d25e544
I20260807 19:55:41.702404 13715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848: Bootstrap starting.
I20260807 19:55:41.706282 13715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:41.707688 13715 log.cc:824] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:55:41 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:41.710779 13715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848: No bootstrap required, opened a new log
I20260807 19:55:41.720312 13720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:41.696629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.5.197.190:34387)
0807 19:55:41.697501 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:41.697517 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:41.697569 (+ 52us) server_negotiation.cc:407] Connection header received
0807 19:55:41.700608 (+ 3039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:41.700642 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:41.701146 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:41.701593 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:41.702921 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:41.704968 (+ 2047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:41.706189 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:41.707252 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:41.707444 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:41.711792 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:41.711804 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:41.711823 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:41.711868 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:41.715794 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:41.716471 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:41.716484 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:41.716493 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:41.716711 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:41.717033 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:41.717038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:41.717042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:41.717781 (+ 739us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:41.718071 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:41.718381 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 19:55:41.718829 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":356,"threads_started":1}
I20260807 19:55:41.721204 13715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "610cc0bdeca34668ad94388da7bfe848" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34387 } }
I20260807 19:55:41.721561 13715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:41.721679 13715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 610cc0bdeca34668ad94388da7bfe848, State: Initialized, Role: FOLLOWER
I20260807 19:55:41.722400 13715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "610cc0bdeca34668ad94388da7bfe848" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34387 } }
I20260807 19:55:41.722697 13715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:41.722846 13715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:41.723120 13715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:41.725430 13715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "610cc0bdeca34668ad94388da7bfe848" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34387 } }
I20260807 19:55:41.725914 13715 leader_election.cc:302] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 610cc0bdeca34668ad94388da7bfe848; no voters:
I20260807 19:55:41.726473 13715 leader_election.cc:288] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:41.726594 13723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:41.727784 13723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [term 1 LEADER]: Becoming Leader. State: Replica: 610cc0bdeca34668ad94388da7bfe848, State: Running, Role: LEADER
I20260807 19:55:41.728312 13723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "610cc0bdeca34668ad94388da7bfe848" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34387 } }
I20260807 19:55:41.728787 13715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:41.731288 13724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "610cc0bdeca34668ad94388da7bfe848" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "610cc0bdeca34668ad94388da7bfe848" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34387 } } }
I20260807 19:55:41.731317 13725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 610cc0bdeca34668ad94388da7bfe848. Latest consensus state: current_term: 1 leader_uuid: "610cc0bdeca34668ad94388da7bfe848" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "610cc0bdeca34668ad94388da7bfe848" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34387 } } }
I20260807 19:55:41.731815 13725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:41.731817 13724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:41.733879 13732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:41.738969 13732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:41.748112 13732 catalog_manager.cc:1347] Generated new cluster ID: 2a16bb2469794509a6cd958e48f9d824
I20260807 19:55:41.748245 13732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:41.775441 13732 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:41.777422 13732 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:41.788406 13732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 610cc0bdeca34668ad94388da7bfe848: Generated new TSK 0
I20260807 19:55:41.789505 13732 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:55:41.856149 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34387
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:42.198081 13755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:42.198372 13755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:42.198513 13755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:42.205821 13755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:42.205924 13755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:42.206075 13755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:42.215936 13755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34387
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:42.217258 13755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:42.218575 13755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:42.232189 13761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:42.232074 13763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:42.232141 13766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:42.233454 13755 server_base.cc:1034] running on GCE node
I20260807 19:55:42.234045 13755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:42.235037 13755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:42.236289 13755 hybrid_clock.cc:648] HybridClock initialized: now 1786132542236231 us; error 51 us; skew 500 ppm
I20260807 19:55:42.236617 13755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:42 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132542, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:42.239799 13755 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:55:42.241284 13755 webserver.cc:460] Webserver started at http://127.5.197.129:41529/ using document root <none> and password file <none>
I20260807 19:55:42.241987 13755 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:42.242100 13755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:42.242424 13755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:42.245448 13755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "ab8f314af8754d38b8f7c52ee6a33fea"
format_stamp: "Formatted at 2026-08-07 19:55:42 on dist-test-slave-6bbx"
server_key: "8598383200a5d0bdccffebe836ce2e1a"
server_key_iv: "f3e6d2fceba2cfb1cf0d6e8d39f286c2"
server_key_version: "encryptionkey@0"
I20260807 19:55:42.246219 13755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "ab8f314af8754d38b8f7c52ee6a33fea"
format_stamp: "Formatted at 2026-08-07 19:55:42 on dist-test-slave-6bbx"
server_key: "8598383200a5d0bdccffebe836ce2e1a"
server_key_iv: "f3e6d2fceba2cfb1cf0d6e8d39f286c2"
server_key_version: "encryptionkey@0"
I20260807 19:55:42.251746 13755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:55:42.255707 13776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:42.257143 13755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:42.257326 13755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "ab8f314af8754d38b8f7c52ee6a33fea"
format_stamp: "Formatted at 2026-08-07 19:55:42 on dist-test-slave-6bbx"
server_key: "8598383200a5d0bdccffebe836ce2e1a"
server_key_iv: "f3e6d2fceba2cfb1cf0d6e8d39f286c2"
server_key_version: "encryptionkey@0"
I20260807 19:55:42.257532 13755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:42.281664 13755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:42.285764 13755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:42.286044 13755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:42.287039 13755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:42.288455 13755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:42.288535 13755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:42.288664 13755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:42.288717 13755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:42.319610 13755 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:44803
I20260807 19:55:42.319645 13941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:44803 every 8 connection(s)
I20260807 19:55:42.320950 13755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:42.323328 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 13755
I20260807 19:55:42.323554 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:42.324384 5910 external_mini_cluster.cc:1428] Setting key afb212182a8ffa97e6d5c1c21ce40430
Aug 07 19:55:42 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132542, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:42.342497 13945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:42.323657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:51401 (local address 127.5.197.190:34387)
0807 19:55:42.324211 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:42.324218 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:42.325256 (+ 1038us) server_negotiation.cc:407] Connection header received
0807 19:55:42.327471 (+ 2215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:42.327476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:42.327559 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:42.327707 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:42.329358 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.330186 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.331762 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.332261 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.332374 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:42.336239 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:42.336250 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:42.336253 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:42.336286 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:42.339278 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:42.340090 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:42.340096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:42.340099 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:42.340253 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:42.340660 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:42.340665 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:42.340669 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:42.341018 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:42.341154 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:42.341875 (+ 721us) server_negotiation.cc:299] Negotiation successful
0807 19:55:42.342095 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":223,"threads_started":1}
I20260807 19:55:42.343252 13947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:42.324252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34387 (local address 127.5.197.129:51401)
0807 19:55:42.325091 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:42.325131 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:42.327200 (+ 2069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:42.327948 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:42.327957 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:42.328520 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:42.329192 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:42.329213 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.330348 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.330353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:42.331618 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:42.331631 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.332490 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.332498 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:42.332732 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:42.333379 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:42.333401 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:42.336001 (+ 2600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:42.339437 (+ 3436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:42.339443 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:42.339456 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:42.339956 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:42.340345 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:42.340348 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:42.340350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:42.340531 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:42.341128 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:42.341133 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:42.341471 (+ 338us) client_negotiation.cc:769] Sending connection context
0807 19:55:42.341699 (+ 228us) client_negotiation.cc:240] Negotiation successful
0807 19:55:42.342114 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":303,"threads_started":1}
I20260807 19:55:42.344782 13943 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34387
I20260807 19:55:42.345140 13943 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:42.346089 13943 heartbeater.cc:511] Master 127.5.197.190:34387 requested a full tablet report, sending...
I20260807 19:55:42.348559 13667 ts_manager.cc:194] Registered new tserver with Master: ab8f314af8754d38b8f7c52ee6a33fea (127.5.197.129:44803)
I20260807 19:55:42.349985 13667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:51401
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:55:42.383914 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34387
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:42.722679 13951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:42.722949 13951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:42.723088 13951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:42.730209 13951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:42.730325 13951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:42.730472 13951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:42.739889 13951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34387
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:42.741044 13951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:42.742364 13951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:42.754937 13957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:42.754956 13958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:42.755084 13960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:42.755846 13951 server_base.cc:1034] running on GCE node
I20260807 19:55:42.756410 13951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:42.757220 13951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:42.758419 13951 hybrid_clock.cc:648] HybridClock initialized: now 1786132542758369 us; error 44 us; skew 500 ppm
I20260807 19:55:42.758678 13951 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:42 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132542, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:42.761621 13951 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:55:42.762992 13951 webserver.cc:460] Webserver started at http://127.5.197.130:39291/ using document root <none> and password file <none>
I20260807 19:55:42.763623 13951 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:42.763768 13951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:42.764056 13951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:42.766820 13951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "d4b3eeed927449e09a01dae8f652208a"
format_stamp: "Formatted at 2026-08-07 19:55:42 on dist-test-slave-6bbx"
server_key: "0a932f4c670ac61f5a8e23f2ffd86ab5"
server_key_iv: "16ecd9349d6231e646204a913556e155"
server_key_version: "encryptionkey@0"
I20260807 19:55:42.767590 13951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "d4b3eeed927449e09a01dae8f652208a"
format_stamp: "Formatted at 2026-08-07 19:55:42 on dist-test-slave-6bbx"
server_key: "0a932f4c670ac61f5a8e23f2ffd86ab5"
server_key_iv: "16ecd9349d6231e646204a913556e155"
server_key_version: "encryptionkey@0"
I20260807 19:55:42.772461 13951 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 19:55:42.775779 13970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:42.776971 13951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:55:42.777115 13951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "d4b3eeed927449e09a01dae8f652208a"
format_stamp: "Formatted at 2026-08-07 19:55:42 on dist-test-slave-6bbx"
server_key: "0a932f4c670ac61f5a8e23f2ffd86ab5"
server_key_iv: "16ecd9349d6231e646204a913556e155"
server_key_version: "encryptionkey@0"
I20260807 19:55:42.777313 13951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:42.800385 13951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:42.804041 13951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:42.804307 13951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:42.805200 13951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:42.806478 13951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:42.806555 13951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:42.806675 13951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:42.806730 13951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:42.837321 13951 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:38635
I20260807 19:55:42.837359 14126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:38635 every 8 connection(s)
I20260807 19:55:42.838579 13951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:42.848865 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 13951
I20260807 19:55:42.849049 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:42.849491 5910 external_mini_cluster.cc:1428] Setting key 20b905664d20ec3570a409d8d5f2409f
Aug 07 19:55:42 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132542, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:42.858322 13945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:42.840967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:42869 (local address 127.5.197.190:34387)
0807 19:55:42.841129 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:42.841133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:42.842276 (+ 1143us) server_negotiation.cc:407] Connection header received
0807 19:55:42.844126 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:42.844131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:42.844223 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:42.844313 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:42.845779 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.846485 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.848467 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.848938 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.849052 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:42.852870 (+ 3818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:42.852875 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:42.852878 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:42.852930 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:42.855421 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:42.856231 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:42.856235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:42.856238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:42.856382 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:42.856807 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:42.856809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:42.856812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:42.857053 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:42.857159 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:42.857898 (+ 739us) server_negotiation.cc:299] Negotiation successful
0807 19:55:42.858064 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 19:55:42.859570 14131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:42.841356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34387 (local address 127.5.197.130:42869)
0807 19:55:42.842107 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:42.842164 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:42.843863 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:42.844546 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:42.844553 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:42.845049 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:42.845600 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:42.845617 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.846636 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.846639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:42.848322 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:42.848337 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:42.849299 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:42.849304 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:42.849496 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:42.850125 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:42.850150 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:42.852649 (+ 2499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:42.855559 (+ 2910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:42.855567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:42.855580 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:42.856130 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:42.856484 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:42.856488 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:42.856491 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:42.856715 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:42.857172 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:42.857178 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:42.857557 (+ 379us) client_negotiation.cc:769] Sending connection context
0807 19:55:42.857832 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 19:55:42.858312 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":309,"threads_started":1}
I20260807 19:55:42.860975 14128 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34387
I20260807 19:55:42.861259 14128 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:42.862053 14128 heartbeater.cc:511] Master 127.5.197.190:34387 requested a full tablet report, sending...
I20260807 19:55:42.863658 13667 ts_manager.cc:194] Registered new tserver with Master: d4b3eeed927449e09a01dae8f652208a (127.5.197.130:38635)
I20260807 19:55:42.864719 13667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:42869
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:55:42.904088 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34387
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:43.239176 14136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:43.239481 14136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:43.239622 14136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:43.246964 14136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:43.247100 14136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:43.247282 14136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:43.257390 14136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34387
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:43.258760 14136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:43.260178 14136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:43.273485 14142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:43.273512 14146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:43.273536 14144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:43.274453 14136 server_base.cc:1034] running on GCE node
I20260807 19:55:43.275081 14136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:43.276113 14136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:43.277330 14136 hybrid_clock.cc:648] HybridClock initialized: now 1786132543277280 us; error 55 us; skew 500 ppm
I20260807 19:55:43.277626 14136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.280961 14136 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:55:43.282552 14136 webserver.cc:460] Webserver started at http://127.5.197.131:43509/ using document root <none> and password file <none>
I20260807 19:55:43.283349 14136 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:43.283473 14136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:43.283921 14136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:43.287045 14136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "290f81b1cdd04b62bee337de65c9c8ac"
format_stamp: "Formatted at 2026-08-07 19:55:43 on dist-test-slave-6bbx"
server_key: "5433c704775d8b1c5d17c9b9eff0582b"
server_key_iv: "4d51966f723b44bedcde19afbd828db9"
server_key_version: "encryptionkey@0"
I20260807 19:55:43.287856 14136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "290f81b1cdd04b62bee337de65c9c8ac"
format_stamp: "Formatted at 2026-08-07 19:55:43 on dist-test-slave-6bbx"
server_key: "5433c704775d8b1c5d17c9b9eff0582b"
server_key_iv: "4d51966f723b44bedcde19afbd828db9"
server_key_version: "encryptionkey@0"
I20260807 19:55:43.293053 14136 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:55:43.296711 14156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:43.298101 14136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 19:55:43.298262 14136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "290f81b1cdd04b62bee337de65c9c8ac"
format_stamp: "Formatted at 2026-08-07 19:55:43 on dist-test-slave-6bbx"
server_key: "5433c704775d8b1c5d17c9b9eff0582b"
server_key_iv: "4d51966f723b44bedcde19afbd828db9"
server_key_version: "encryptionkey@0"
I20260807 19:55:43.298460 14136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:43.319543 14136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:43.324952 14136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:43.325304 14136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:43.326409 14136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:43.327852 14136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:43.327926 14136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:43.328023 14136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:43.328068 14136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:43.353457 13943 heartbeater.cc:503] Master 127.5.197.190:34387 was elected leader, sending a full tablet report...
I20260807 19:55:43.361317 14136 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:42893
I20260807 19:55:43.361387 14316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:42893 every 8 connection(s)
I20260807 19:55:43.362691 14136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:43.366683 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 14136
I20260807 19:55:43.366907 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:43.367362 5910 external_mini_cluster.cc:1428] Setting key 7e19ed2e5d77a136773de393c5da7201
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:55:43.382894 14319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.365264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:50143 (local address 127.5.197.190:34387)
0807 19:55:43.365741 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.365746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.366770 (+ 1024us) server_negotiation.cc:407] Connection header received
0807 19:55:43.368831 (+ 2061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.368837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.368927 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.369052 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.370762 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.371535 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.373097 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.373478 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.373572 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.376972 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:43.376977 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:43.376981 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:43.377014 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:43.379464 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.380272 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.380277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.380279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.380412 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.380913 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.380918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.380921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.381219 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:43.381374 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:43.382262 (+ 888us) server_negotiation.cc:299] Negotiation successful
0807 19:55:43.382506 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":251,"threads_started":1}
I20260807 19:55:43.383930 14321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.365815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34387 (local address 127.5.197.131:50143)
0807 19:55:43.366599 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:43.366645 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:43.368501 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:43.369375 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:43.369384 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:43.369902 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:43.370573 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:43.370594 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.371712 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.371718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:43.372973 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:43.372985 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.373678 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.373683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:43.373887 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.374486 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:43.374508 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:43.376768 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:43.379622 (+ 2854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:43.379630 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:43.379643 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:43.380130 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:43.380525 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:43.380529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:43.380532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:43.380770 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:43.381370 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:43.381379 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:43.381810 (+ 431us) client_negotiation.cc:769] Sending connection context
0807 19:55:43.382111 (+ 301us) client_negotiation.cc:240] Negotiation successful
0807 19:55:43.382699 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":351,"threads_started":1}
I20260807 19:55:43.385186 14317 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34387
I20260807 19:55:43.385493 14317 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:43.386230 14317 heartbeater.cc:511] Master 127.5.197.190:34387 requested a full tablet report, sending...
I20260807 19:55:43.387713 13667 ts_manager.cc:194] Registered new tserver with Master: 290f81b1cdd04b62bee337de65c9c8ac (127.5.197.131:42893)
I20260807 19:55:43.388511 13667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:50143
I20260807 19:55:43.395196 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/test-admin.keytab.
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.429248 5910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 19:55:43.434490 14326 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:43.431934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.5.197.129:44803)
0807 19:55:43.432643 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.432651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.432678 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:55:43.432761 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.432768 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.432985 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.433114 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.434046 (+ 932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53764: BlockingRecv error: recv got EOF from 127.0.0.1:53764 (error 108)
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":392,"threads_started":1}
W20260807 19:55:43.434620 5910 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5cc' of type FILE
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.436733 5910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.438061 5910 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:43.453311 14326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.439809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53776 (local address 127.5.197.129:44803)
0807 19:55:43.439996 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.440002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.440122 (+ 120us) server_negotiation.cc:407] Connection header received
0807 19:55:43.440306 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.440310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.440379 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.440461 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.441471 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.442464 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.443697 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.444272 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.444401 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.447999 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:43.448013 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:43.448028 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:43.448070 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:43.450715 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.451368 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.451375 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.451377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.451500 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.451873 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.451877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.451879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.452276 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:43.452534 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:43.452774 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 19:55:43.453034 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 19:55:43.458778 14326 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:43.457365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53790 (local address 127.5.197.129:44803)
0807 19:55:43.457567 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.457572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.457694 (+ 122us) server_negotiation.cc:407] Connection header received
0807 19:55:43.457823 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.457827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.457881 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.457946 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.458564 (+ 618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53790: BlockingRecv error: recv got EOF from 127.0.0.1:53790 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 19:55:43.458968 5910 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5cc' of type FILE
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.460464 5910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.461789 5910 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:43.475189 14326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.463151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53802 (local address 127.5.197.129:44803)
0807 19:55:43.463362 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.463368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.463596 (+ 228us) server_negotiation.cc:407] Connection header received
0807 19:55:43.463730 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.463733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.463794 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.463870 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.464730 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.465439 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.466675 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.467121 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.467240 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.470526 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:43.470531 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:43.470534 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:43.470577 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:43.472980 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.473557 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.473560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.473563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.473675 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.473959 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.473962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.473964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.474218 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:43.474428 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:43.474710 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 19:55:43.474886 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260807 19:55:43.479097 14326 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:43.477601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53816 (local address 127.5.197.129:44803)
0807 19:55:43.477741 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.477746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.478007 (+ 261us) server_negotiation.cc:407] Connection header received
0807 19:55:43.478121 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.478124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.478191 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.478305 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.478885 (+ 580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53816: BlockingRecv error: recv got EOF from 127.0.0.1:53816 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 19:55:43.479354 5910 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132491354022-5910-0/krb5kdc/krb5cc' of type FILE
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.480831 5910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:43.482100 5910 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:55:43.495540 14326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.483329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53822 (local address 127.5.197.129:44803)
0807 19:55:43.483521 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.483526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.483754 (+ 228us) server_negotiation.cc:407] Connection header received
0807 19:55:43.483882 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.483885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.483938 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.484012 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.484879 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.485597 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.486812 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.487211 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.487297 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.490910 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:43.490916 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:43.490919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:43.490957 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:43.493352 (+ 2395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.493971 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.493976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.493978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.494137 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.494411 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.494414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.494416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.494686 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:43.494912 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:43.495080 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 19:55:43.495238 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 19:55:43.497116 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 13755
I20260807 19:55:43.508555 14326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.497772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53834 (local address 127.5.197.129:44803)
0807 19:55:43.497932 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.497938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.498250 (+ 312us) server_negotiation.cc:407] Connection header received
0807 19:55:43.498427 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.498430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.498483 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.498558 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.499468 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.500205 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.501408 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.501858 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.501965 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.503959 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:43.503964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:43.503967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:43.503996 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:43.506170 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.506768 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.506774 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.506777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.506909 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.507246 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.507251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.507254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.507508 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:43.507793 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:43.508077 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 19:55:43.508272 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:55:43.509120 13933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:43.593212 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 13755
I20260807 19:55:43.617986 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 13951
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:55:43.633404 14348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.618843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53664 (local address 127.5.197.130:38635)
0807 19:55:43.619371 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.619378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.619404 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:55:43.619466 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.619473 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.619749 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.619913 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.620930 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.621979 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.623205 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.623801 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.623914 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.627741 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:43.627752 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:43.627766 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:43.627807 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:43.630739 (+ 2932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.631454 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.631462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.631464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.631602 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.631960 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.631963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.631965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.632348 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:43.632583 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:43.632886 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 19:55:43.633092 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":245,"threads_started":1}
I20260807 19:55:43.634938 14118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:43.716676 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 13951
I20260807 19:55:43.738587 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 14136
Aug 07 19:55:43 dist-test-slave-6bbx krb5kdc[13603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:55:43.753530 14350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:43.739496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51870 (local address 127.5.197.131:42893)
0807 19:55:43.740193 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:43.740200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:43.740234 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:55:43.740323 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:43.740337 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:43.740605 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:43.740742 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:43.741742 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.742811 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.744119 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:43.744661 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:43.744764 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:43.748495 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:43.748507 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:43.748521 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:43.748553 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:43.751172 (+ 2619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.751813 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.751820 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.751822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.751944 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:43.752239 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:43.752242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:43.752244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:43.752573 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:43.752804 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:43.752984 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 19:55:43.753209 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":388,"threads_started":1}
I20260807 19:55:43.754854 14311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:43.837589 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 14136
I20260807 19:55:43.858625 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 13629
I20260807 19:55:43.859932 13706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:43.969695 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 13629
2026-08-07T19:55:43Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4125 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:44 dist-test-slave-6bbx krb5kdc[14357](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:44 dist-test-slave-6bbx krb5kdc[14357](info): set up 2 sockets
Aug 07 19:55:44 dist-test-slave-6bbx krb5kdc[14357](info): commencing operation
krb5kdc: starting...
W20260807 19:55:45.161231 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:45 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:45Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab.
Entry for principal oryx/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab.
I20260807 19:55:45.428527 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45893
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab
--principal=oryx/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45893
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:45.770607 14376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:45.770916 14376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:45.771008 14376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:45.778414 14376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:45.778539 14376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:45.778594 14376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:45.778650 14376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:45.778693 14376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:45.788858 14376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab
--principal=oryx/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:45.790367 14376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:45.791870 14376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:45.804145 14384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:45.804200 14390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:45.804365 14392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:45.805014 14376 server_base.cc:1034] running on GCE node
I20260807 19:55:45.805886 14376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:45.807391 14376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:45.808612 14376 hybrid_clock.cc:648] HybridClock initialized: now 1786132545808559 us; error 29 us; skew 500 ppm
I20260807 19:55:45.808974 14376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:45 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:45.812188 14376 init.cc:377] Logged in from keytab as oryx/127.5.197.190@KRBTEST.COM (short username oryx)
I20260807 19:55:45.813820 14376 webserver.cc:460] Webserver started at http://127.5.197.190:40717/ using document root <none> and password file <none>
I20260807 19:55:45.814558 14376 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:45.814687 14376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:45.815001 14376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:45.818184 14376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "b1957c47155540b2b123544a1147f0b9"
format_stamp: "Formatted at 2026-08-07 19:55:45 on dist-test-slave-6bbx"
server_key: "63ffae18976909b0857a0721e93a13d9"
server_key_iv: "04a9258f54671d175333a4d37a75b2fa"
server_key_version: "encryptionkey@0"
I20260807 19:55:45.818977 14376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "b1957c47155540b2b123544a1147f0b9"
format_stamp: "Formatted at 2026-08-07 19:55:45 on dist-test-slave-6bbx"
server_key: "63ffae18976909b0857a0721e93a13d9"
server_key_iv: "04a9258f54671d175333a4d37a75b2fa"
server_key_version: "encryptionkey@0"
I20260807 19:55:45.824513 14376 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 19:55:45.828148 14404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:45.829530 14376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 19:55:45.829711 14376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "b1957c47155540b2b123544a1147f0b9"
format_stamp: "Formatted at 2026-08-07 19:55:45 on dist-test-slave-6bbx"
server_key: "63ffae18976909b0857a0721e93a13d9"
server_key_iv: "04a9258f54671d175333a4d37a75b2fa"
server_key_version: "encryptionkey@0"
I20260807 19:55:45.829909 14376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:45.847100 14376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:45.851519 14376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:45.851843 14376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:45.870000 14376 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:45893
I20260807 19:55:45.870023 14477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:45893 every 8 connection(s)
I20260807 19:55:45.871469 14376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:45.874720 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 14376
I20260807 19:55:45.874941 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:45.875581 14478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:45.875591 5910 external_mini_cluster.cc:1428] Setting key 49d58432bd43239aaf502d0bc31039f3
I20260807 19:55:45.890568 14478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: Bootstrap starting.
Aug 07 19:55:45 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:45.894804 14478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:45.896291 14478 log.cc:824] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:45.900106 14478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: No bootstrap required, opened a new log
I20260807 19:55:45.901329 14483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:45.877610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37836 (local address 127.5.197.190:45893)
0807 19:55:45.878497 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:45.878513 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:45.878575 (+ 62us) server_negotiation.cc:407] Connection header received
0807 19:55:45.880770 (+ 2195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:45.880805 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:45.881413 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:45.881911 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:45.883369 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:45.885362 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:45.886691 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:45.887876 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:45.888063 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:45.892286 (+ 4223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:45.892298 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:45.892333 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:45.892392 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:45.896439 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:45.897344 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:45.897353 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:45.897360 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:45.897552 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:45.898014 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:45.898019 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:45.898022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:45.898800 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:45.899136 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:45.899444 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 19:55:45.899938 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":332,"threads_started":1}
I20260807 19:55:45.908351 14478 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } }
I20260807 19:55:45.908771 14478 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:45.908888 14478 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1957c47155540b2b123544a1147f0b9, State: Initialized, Role: FOLLOWER
I20260807 19:55:45.909475 14478 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } }
I20260807 19:55:45.909706 14478 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:45.909832 14478 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:45.910002 14478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:45.912292 14478 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } }
I20260807 19:55:45.912789 14478 leader_election.cc:302] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1957c47155540b2b123544a1147f0b9; no voters:
I20260807 19:55:45.913414 14478 leader_election.cc:288] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:45.913558 14485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:45.914605 14485 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 1 LEADER]: Becoming Leader. State: Replica: b1957c47155540b2b123544a1147f0b9, State: Running, Role: LEADER
I20260807 19:55:45.915278 14485 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } }
I20260807 19:55:45.915729 14478 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:45.918159 14488 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1957c47155540b2b123544a1147f0b9. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } }
I20260807 19:55:45.918511 14488 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:45.919051 14486 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } }
I20260807 19:55:45.919399 14486 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:45.920984 14498 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:45.926110 14498 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:45.935389 14498 catalog_manager.cc:1347] Generated new cluster ID: b742d50cc4bd435c950e305ee8ad1e27
I20260807 19:55:45.935508 14498 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:45.955015 14498 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:45.956663 14498 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:45.967551 14498 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: Generated new TSK 0
I20260807 19:55:45.968497 14498 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab.
Entry for principal oryx/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab.
I20260807 19:55:46.035395 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45893
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab
--principal=oryx/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:46.412097 14516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:46.412413 14516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:46.412513 14516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:46.420265 14516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:46.420392 14516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:46.420516 14516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:46.430927 14516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab
--principal=oryx/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:46.432420 14516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:46.433876 14516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:46.447749 14531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:46.447810 14526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:46.447839 14529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:46.453562 14516 server_base.cc:1034] running on GCE node
I20260807 19:55:46.454355 14516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:46.455549 14516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:46.456776 14516 hybrid_clock.cc:648] HybridClock initialized: now 1786132546456712 us; error 52 us; skew 500 ppm
I20260807 19:55:46.457130 14516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:46 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132546, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:46.460464 14516 init.cc:377] Logged in from keytab as oryx/127.5.197.129@KRBTEST.COM (short username oryx)
I20260807 19:55:46.461942 14516 webserver.cc:460] Webserver started at http://127.5.197.129:37829/ using document root <none> and password file <none>
I20260807 19:55:46.462734 14516 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:46.462860 14516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:46.463186 14516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:46.466281 14516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "480eb59f7269473b8b88b1565af9baaa"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "d34e680fc67b7e8115da6d02037b6844"
server_key_iv: "7927f663150ddaead08e926178473817"
server_key_version: "encryptionkey@0"
I20260807 19:55:46.467072 14516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "480eb59f7269473b8b88b1565af9baaa"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "d34e680fc67b7e8115da6d02037b6844"
server_key_iv: "7927f663150ddaead08e926178473817"
server_key_version: "encryptionkey@0"
I20260807 19:55:46.472306 14516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 19:55:46.475739 14538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:46.477061 14516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 19:55:46.477231 14516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "480eb59f7269473b8b88b1565af9baaa"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "d34e680fc67b7e8115da6d02037b6844"
server_key_iv: "7927f663150ddaead08e926178473817"
server_key_version: "encryptionkey@0"
I20260807 19:55:46.477434 14516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:46.490684 14516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:46.494299 14516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:46.494572 14516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:46.495494 14516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:46.496891 14516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:46.496971 14516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:46.497092 14516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:46.497150 14516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:46.528637 14516 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:35183
I20260807 19:55:46.528679 14707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:35183 every 8 connection(s)
I20260807 19:55:46.529891 14516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:46.537182 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 14516
I20260807 19:55:46.537425 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:46.538214 5910 external_mini_cluster.cc:1428] Setting key f9644225ec5154ab3ff047282951426e
Aug 07 19:55:46 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132546, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:46.550933 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:46.532270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:35797 (local address 127.5.197.190:45893)
0807 19:55:46.532737 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:46.532743 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:46.533823 (+ 1080us) server_negotiation.cc:407] Connection header received
0807 19:55:46.535615 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:46.535619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:46.535727 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:46.535828 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:46.537447 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:46.538504 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:46.540794 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:46.541395 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:46.541520 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:46.544985 (+ 3465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:46.544991 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:46.544994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:46.545031 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:46.547962 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:46.548652 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:46.548657 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:46.548659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:46.548805 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:46.549187 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:46.549191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:46.549194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:46.549512 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:46.549651 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:46.550381 (+ 730us) server_negotiation.cc:299] Negotiation successful
0807 19:55:46.550590 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":212,"threads_started":1}
I20260807 19:55:46.552006 14713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:46.532804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.129:35797)
0807 19:55:46.533627 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:46.533691 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:46.535377 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:46.536012 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:46.536020 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:46.536562 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:46.537214 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:46.537241 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:46.538707 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:46.538712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:46.540640 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:46.540654 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:46.541585 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:46.541590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:46.541778 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:46.542452 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:46.542475 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:46.544761 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:46.548096 (+ 3335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:46.548103 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:46.548115 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:46.548540 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:46.548907 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:46.548910 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:46.548912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:46.549093 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:46.549663 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:46.549670 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:46.549988 (+ 318us) client_negotiation.cc:769] Sending connection context
0807 19:55:46.550255 (+ 267us) client_negotiation.cc:240] Negotiation successful
0807 19:55:46.550648 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":281,"threads_started":1}
I20260807 19:55:46.553583 14709 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45893
I20260807 19:55:46.553903 14709 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:46.554625 14709 heartbeater.cc:511] Master 127.5.197.190:45893 requested a full tablet report, sending...
I20260807 19:55:46.556928 14431 ts_manager.cc:194] Registered new tserver with Master: 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:46.558866 14431 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:35797
WARNING: no policy specified for oryx/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab.
Entry for principal oryx/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab.
I20260807 19:55:46.594687 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45893
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab
--principal=oryx/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:46.924304 14718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:46.924630 14718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:46.924736 14718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:46.932512 14718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:46.932660 14718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:46.932825 14718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:46.943023 14718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab
--principal=oryx/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:46.944414 14718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:46.945808 14718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:46.959064 14725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:46.959105 14726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:46.959126 14728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:46.960003 14718 server_base.cc:1034] running on GCE node
I20260807 19:55:46.960701 14718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:46.961699 14718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:46.962914 14718 hybrid_clock.cc:648] HybridClock initialized: now 1786132546962864 us; error 44 us; skew 500 ppm
I20260807 19:55:46.963240 14718 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:46 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132546, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:46.970127 14718 init.cc:377] Logged in from keytab as oryx/127.5.197.130@KRBTEST.COM (short username oryx)
I20260807 19:55:46.971760 14718 webserver.cc:460] Webserver started at http://127.5.197.130:41189/ using document root <none> and password file <none>
I20260807 19:55:46.972497 14718 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:46.972620 14718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:46.972942 14718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:46.976114 14718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "e8854ba1c579d71bbe66d74c47f32843"
server_key_iv: "dde46fc2fdc8ea606ccfeb87a47b3faa"
server_key_version: "encryptionkey@0"
I20260807 19:55:46.976918 14718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "e8854ba1c579d71bbe66d74c47f32843"
server_key_iv: "dde46fc2fdc8ea606ccfeb87a47b3faa"
server_key_version: "encryptionkey@0"
I20260807 19:55:46.982439 14718 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 19:55:46.986179 14737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:46.987845 14718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:46.988021 14718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "e8854ba1c579d71bbe66d74c47f32843"
server_key_iv: "dde46fc2fdc8ea606ccfeb87a47b3faa"
server_key_version: "encryptionkey@0"
I20260807 19:55:46.988219 14718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:47.014328 14718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:47.018652 14718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:47.018953 14718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:47.020000 14718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:47.021401 14718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:47.021483 14718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:47.021610 14718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:47.021665 14718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:47.052681 14718 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:38761
I20260807 19:55:47.052773 14898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:38761 every 8 connection(s)
I20260807 19:55:47.054019 14718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:47.058236 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 14718
I20260807 19:55:47.058477 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:47.059051 5910 external_mini_cluster.cc:1428] Setting key c2af618bef53fd31944cfd666dd90269
Aug 07 19:55:47 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132546, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:47.078735 14902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:47.057371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.130:60585)
0807 19:55:47.058200 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:47.058266 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:47.060345 (+ 2079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:47.061074 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:47.061086 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:47.061860 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:47.062701 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:47.062729 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.063882 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.063887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:47.065619 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:47.065639 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.066423 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.066429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:47.066696 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:47.067429 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:47.067458 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:47.070161 (+ 2703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:47.073701 (+ 3540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:47.073709 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:47.073724 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:47.074183 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:47.074667 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:47.074673 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:47.074696 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:47.074993 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:47.075711 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:47.075723 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:47.076232 (+ 509us) client_negotiation.cc:769] Sending connection context
0807 19:55:47.076570 (+ 338us) client_negotiation.cc:240] Negotiation successful
0807 19:55:47.077186 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":273,"threads_started":1}
I20260807 19:55:47.079144 14901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:47.056723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:60585 (local address 127.5.197.190:45893)
0807 19:55:47.057209 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:47.057216 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:47.059715 (+ 2499us) server_negotiation.cc:407] Connection header received
0807 19:55:47.060613 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:47.060619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:47.060714 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:47.060811 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:47.062889 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.063712 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.065771 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.066196 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.066296 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:47.070432 (+ 4136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:47.070437 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:47.070440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:47.070477 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:47.073542 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:47.074320 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:47.074325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:47.074329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:47.074490 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:47.075126 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:47.075131 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:47.075134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:47.075508 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:47.075654 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:47.078531 (+ 2877us) server_negotiation.cc:299] Negotiation successful
0807 19:55:47.078783 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":223,"threads_started":1}
I20260807 19:55:47.081449 14899 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45893
I20260807 19:55:47.081910 14899 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:47.082959 14899 heartbeater.cc:511] Master 127.5.197.190:45893 requested a full tablet report, sending...
I20260807 19:55:47.084971 14431 ts_manager.cc:194] Registered new tserver with Master: 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761)
I20260807 19:55:47.086176 14431 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:60585
WARNING: no policy specified for oryx/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab.
Entry for principal oryx/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab.
I20260807 19:55:47.121271 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45893
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab
--principal=oryx/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:47.461769 14905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:47.462054 14905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:47.462212 14905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:47.469703 14905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:47.469825 14905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:47.469990 14905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:47.479765 14905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab
--principal=oryx/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:47.481135 14905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:47.482556 14905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:47.495582 14914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:47.495550 14916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:47.495692 14913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:47.496461 14905 server_base.cc:1034] running on GCE node
I20260807 19:55:47.497073 14905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:47.498077 14905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:47.499294 14905 hybrid_clock.cc:648] HybridClock initialized: now 1786132547499244 us; error 48 us; skew 500 ppm
I20260807 19:55:47.499600 14905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:47 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132547, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:47.506480 14905 init.cc:377] Logged in from keytab as oryx/127.5.197.131@KRBTEST.COM (short username oryx)
I20260807 19:55:47.508142 14905 webserver.cc:460] Webserver started at http://127.5.197.131:34199/ using document root <none> and password file <none>
I20260807 19:55:47.508874 14905 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:47.508980 14905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:47.509259 14905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:47.512312 14905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "adddd87259a44c0ea76e067c17e492d7"
format_stamp: "Formatted at 2026-08-07 19:55:47 on dist-test-slave-6bbx"
server_key: "3c29a0fc5721546384ff80db854b0344"
server_key_iv: "c69b83312a8158b0925d7deaff22b606"
server_key_version: "encryptionkey@0"
I20260807 19:55:47.513024 14905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "adddd87259a44c0ea76e067c17e492d7"
format_stamp: "Formatted at 2026-08-07 19:55:47 on dist-test-slave-6bbx"
server_key: "3c29a0fc5721546384ff80db854b0344"
server_key_iv: "c69b83312a8158b0925d7deaff22b606"
server_key_version: "encryptionkey@0"
I20260807 19:55:47.518296 14905 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:55:47.521883 14928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:47.523344 14905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:47.523506 14905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "adddd87259a44c0ea76e067c17e492d7"
format_stamp: "Formatted at 2026-08-07 19:55:47 on dist-test-slave-6bbx"
server_key: "3c29a0fc5721546384ff80db854b0344"
server_key_iv: "c69b83312a8158b0925d7deaff22b606"
server_key_version: "encryptionkey@0"
I20260807 19:55:47.523736 14905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:47.561841 14709 heartbeater.cc:503] Master 127.5.197.190:45893 was elected leader, sending a full tablet report...
I20260807 19:55:47.574704 14905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:47.579010 14905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:47.579315 14905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:47.580369 14905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:47.581806 14905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:47.581888 14905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:47.582012 14905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:47.582068 14905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:47.613826 14905 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:37887
I20260807 19:55:47.613875 15084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:37887 every 8 connection(s)
I20260807 19:55:47.615188 14905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:47.617468 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 14905
I20260807 19:55:47.617694 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:47.618285 5910 external_mini_cluster.cc:1428] Setting key 16038ad67d0b7e49aed5aaf1af61296e
Aug 07 19:55:47 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132547, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:47.635589 15088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:47.618024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:57351 (local address 127.5.197.190:45893)
0807 19:55:47.618498 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:47.618503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:47.619764 (+ 1261us) server_negotiation.cc:407] Connection header received
0807 19:55:47.622033 (+ 2269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:47.622038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:47.622140 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:47.622245 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:47.623754 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.624587 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.626092 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.626498 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.626606 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:47.630028 (+ 3422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:47.630033 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:47.630037 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:47.630068 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:47.632444 (+ 2376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:47.633190 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:47.633196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:47.633199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:47.633353 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:47.633922 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:47.633925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:47.633927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:47.634253 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:47.634378 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:47.635131 (+ 753us) server_negotiation.cc:299] Negotiation successful
0807 19:55:47.635305 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":223,"threads_started":1}
I20260807 19:55:47.636660 15092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:47.618737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:57351)
0807 19:55:47.619588 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:47.619632 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:47.621779 (+ 2147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:47.622500 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:47.622509 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:47.623027 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:47.623581 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:47.623599 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.624727 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.624730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:47.625953 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:47.625965 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:47.626717 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:47.626725 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:47.626945 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:47.627542 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:47.627569 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:47.629817 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:47.632575 (+ 2758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:47.632585 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:47.632602 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:47.633069 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:47.633491 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:47.633495 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:47.633498 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:47.633811 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:47.634404 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:47.634410 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:47.634801 (+ 391us) client_negotiation.cc:769] Sending connection context
0807 19:55:47.635058 (+ 257us) client_negotiation.cc:240] Negotiation successful
0807 19:55:47.635500 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":304,"threads_started":1}
I20260807 19:55:47.638185 15085 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45893
I20260807 19:55:47.638475 15085 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:47.639207 15085 heartbeater.cc:511] Master 127.5.197.190:45893 requested a full tablet report, sending...
I20260807 19:55:47.640715 14431 ts_manager.cc:194] Registered new tserver with Master: adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887)
I20260807 19:55:47.641538 14431 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:57351
I20260807 19:55:47.645922 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.197.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.189.keytab.
Entry for principal oryx/127.5.197.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.189.keytab.
I20260807 19:55:47.711411 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:41493
--webserver_interface=127.5.197.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.189.keytab
--principal=oryx/127.5.197.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45893,127.5.197.189:41493
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:48.074959 15095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:48.075275 15095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:48.075408 15095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:48.082682 15095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:48.082790 15095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:48.082864 15095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:48.082947 15095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:48.083011 15095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:48.089033 14899 heartbeater.cc:503] Master 127.5.197.190:45893 was elected leader, sending a full tablet report...
I20260807 19:55:48.093756 15095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45893,127.5.197.189:41493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.189.keytab
--principal=oryx/127.5.197.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:41493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.197.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
W20260807 19:55:48.094139 15095 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.5.197.190:45893,127.5.197.189:41493'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 19:55:48.095206 15095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:48.096577 15095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:48.108242 15106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:48.108299 15102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:48.108299 15103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:48.109236 15095 server_base.cc:1034] running on GCE node
I20260807 19:55:48.110008 15095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:48.111362 15095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:48.112614 15095 hybrid_clock.cc:648] HybridClock initialized: now 1786132548112510 us; error 70 us; skew 500 ppm
I20260807 19:55:48.112987 15095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:48.116355 15095 init.cc:377] Logged in from keytab as oryx/127.5.197.189@KRBTEST.COM (short username oryx)
I20260807 19:55:48.117861 15095 webserver.cc:460] Webserver started at http://127.5.197.189:44975/ using document root <none> and password file <none>
I20260807 19:55:48.118552 15095 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:48.118644 15095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:48.118919 15095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:48.121976 15095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/instance:
uuid: "741c64d32b914d9b8e74c5a610aa2834"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "de4bc3296c2f31cc72609ebd884eafe5"
server_key_iv: "e25bf87afb508ddab129e4ca2b8f435a"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.122752 15095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal/instance:
uuid: "741c64d32b914d9b8e74c5a610aa2834"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "de4bc3296c2f31cc72609ebd884eafe5"
server_key_iv: "e25bf87afb508ddab129e4ca2b8f435a"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.128085 15095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 19:55:48.131719 15117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:48.133093 15095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:48.133332 15095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
uuid: "741c64d32b914d9b8e74c5a610aa2834"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "de4bc3296c2f31cc72609ebd884eafe5"
server_key_iv: "e25bf87afb508ddab129e4ca2b8f435a"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.133529 15095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:48.152519 15095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:48.156422 15095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:48.156638 15095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:48.174045 15095 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.189:41493
I20260807 19:55:48.174072 15191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.189:41493 every 8 connection(s)
I20260807 19:55:48.175393 15095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
I20260807 19:55:48.179112 15193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:48.183045 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 15095
I20260807 19:55:48.186444 15193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.189@KRBTEST.COM
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.189@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:48.206440 15200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.190536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37198 (local address 127.5.197.190:45893)
0807 19:55:48.191859 (+ 1323us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.191865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.191885 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:55:48.191949 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.191954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.192045 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.192241 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.193398 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.194100 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.195716 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.196199 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.196304 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.200213 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.200219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.200223 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.200264 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.203414 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.204222 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.204227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.204231 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.204364 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.204757 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.204762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.204765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.205171 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.205323 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.205879 (+ 556us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.206097 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1202,"thread_start_us":1053,"threads_started":1}
I20260807 19:55:48.207206 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.185502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45470 (local address 127.5.197.189:41493)
0807 19:55:48.186387 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.186402 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.186794 (+ 392us) server_negotiation.cc:407] Connection header received
0807 19:55:48.188522 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.188551 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.189027 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.189447 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.190993 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.192827 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.194213 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.194951 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.195073 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.199900 (+ 4827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.199908 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.199919 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.199948 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.203193 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.203934 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.203940 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.203942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.204137 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.204512 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.204515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.204517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.205124 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.205420 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.205734 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.206124 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":624,"spinlock_wait_cycles":12672,"thread_start_us":372,"threads_started":1}
I20260807 19:55:48.207244 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.190492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37198)
0807 19:55:48.191227 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.191296 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.191479 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.192286 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.192290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.192914 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.193242 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.193255 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.194238 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.194242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.195548 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.195564 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.196427 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.196435 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.196616 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.197219 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.197250 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.200028 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.203530 (+ 3502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.203541 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.203552 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.204115 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.204472 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.204477 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.204480 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.204650 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.205289 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.205296 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.205500 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.205769 (+ 269us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.206274 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":127,"thread_start_us":266,"threads_started":1}
I20260807 19:55:48.210186 15193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.189@KRBTEST.COM for oryx/127.5.197.189@KRBTEST.COM
I20260807 19:55:48.221592 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.210714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45476)
0807 19:55:48.210914 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.210929 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.211028 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.211300 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.211304 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.211612 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.211785 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.211794 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.212721 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.212726 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.213552 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.213563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.214286 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.214291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.214483 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.214964 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.214978 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.217019 (+ 2041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.219576 (+ 2557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.219583 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.219585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.219975 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.220307 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.220310 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.220312 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.220440 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.220901 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.220905 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.221044 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.221158 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.221365 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 19:55:48.221776 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.210921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45476 (local address 127.5.197.189:41493)
0807 19:55:48.211072 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.211077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.211093 (+ 16us) server_negotiation.cc:407] Connection header received
0807 19:55:48.211131 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.211135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.211182 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.211256 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.211905 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.212587 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.213707 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.214147 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.214256 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.217178 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.217183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.217185 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.217214 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.219450 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.220084 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.220087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.220089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.220203 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.220534 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.220537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.220539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.220799 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.220902 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.221242 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.221473 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":60}
I20260807 19:55:48.226305 15193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Bootstrap starting.
I20260807 19:55:48.229514 15193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:48.230520 15193 log.cc:824] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:48.233203 15193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: No bootstrap required, opened a new log
I20260807 19:55:48.240228 15193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } }
I20260807 19:55:48.240545 15193 raft_consensus.cc:374] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:48.240639 15193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 741c64d32b914d9b8e74c5a610aa2834, State: Initialized, Role: FOLLOWER
I20260807 19:55:48.241163 15193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } }
I20260807 19:55:48.242033 15204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } } }
I20260807 19:55:48.242370 15204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:55:48.242974 15193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 19:55:48.251538 15220 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:55:48.251762 15220 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:55:48.253937 15095 master_runner.cc:428] Detected that this master 741c64d32b914d9b8e74c5a610aa2834 is joining an existing cluster
I20260807 19:55:48.254014 15095 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.197.189:41493
I20260807 19:55:48.273943 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.258471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45484 (local address 127.5.197.189:41493)
0807 19:55:48.258626 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.258632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.260247 (+ 1615us) server_negotiation.cc:407] Connection header received
0807 19:55:48.260379 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.260383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.260452 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.260536 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.261839 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.262926 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.264786 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.265479 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.265600 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.267832 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.267839 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.267843 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.267876 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.271134 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.271930 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.271934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.271938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.272084 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.272458 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.272462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.272464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.272825 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.272952 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.273376 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.273573 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":50}
I20260807 19:55:48.274646 15200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.257639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37202 (local address 127.5.197.190:45893)
0807 19:55:48.257846 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.257854 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.258424 (+ 570us) server_negotiation.cc:407] Connection header received
0807 19:55:48.258688 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.258693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.258793 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.258869 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.260924 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.262018 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.264137 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.264822 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.264922 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.268094 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.268100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.268105 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.268145 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.271493 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.272301 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.272307 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.272311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.272471 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.272946 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.272951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.272954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.273328 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.273459 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.274062 (+ 603us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.274317 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:55:48.275373 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.258404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45484)
0807 19:55:48.260139 (+ 1735us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.260165 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.260283 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.260718 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.260723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.261365 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.261694 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.261707 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.263139 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.263143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.264637 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.264661 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.265667 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.265673 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.265822 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.266439 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.266464 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.267606 (+ 1142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.271266 (+ 3660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.271270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.271274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.271817 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.272201 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.272204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.272207 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.272360 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.273010 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.273013 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.273144 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.274398 (+ 1254us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.274677 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1641,"mutex_wait_us":1,"thread_start_us":1458,"threads_started":1}
I20260807 19:55:48.275826 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.257642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37202)
0807 19:55:48.258321 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.258341 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.258533 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.259087 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.259092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.259865 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.260732 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.260747 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.262233 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.262239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.263955 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.263970 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.265800 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.265809 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.265968 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.266564 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.266587 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.267867 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.271652 (+ 3785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.271657 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.271685 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.272136 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.272627 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.272631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.272634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.272805 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.273542 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.273547 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.273744 (+ 197us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.274892 (+ 1148us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.275217 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":1,"thread_start_us":328,"threads_started":1}
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.190@KRBTEST.COM for oryx/127.5.197.189@KRBTEST.COM
WARNING: no policy specified for oryx/127.5.197.188@KRBTEST.COM; defaulting to no policy
I20260807 19:55:48.296321 15198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.281738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45490 (local address 127.5.197.189:41493)
0807 19:55:48.281924 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.281929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.282515 (+ 586us) server_negotiation.cc:407] Connection header received
0807 19:55:48.282776 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.282781 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.282855 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.282936 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.284044 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.284697 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.285966 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.286543 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.286682 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.290744 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.290748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.290752 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.290784 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.293582 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.294257 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.294262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.294267 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.294407 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.294819 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.294823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.294825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.295096 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.295244 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.295739 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.295963 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:55:48.296386 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.281690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45490)
0807 19:55:48.282393 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.282433 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.282596 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.283008 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.283015 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.283624 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.283894 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.283904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.284830 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.284835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.285832 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.285844 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.286724 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.286730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.286915 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.287507 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.287524 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.290555 (+ 3031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.293747 (+ 3192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.293757 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.293763 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.294132 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.294517 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.294521 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.294525 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.294688 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.295235 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.295244 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.295402 (+ 158us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.295576 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.295952 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":274,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.188@KRBTEST.COM" created.
I20260807 19:55:48.298565 14431 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.5.197.189:41493: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834"
member_type: NON_VOTER
last_known_addr {
host: "127.5.197.189"
port: 41493
}
attrs {
promote: true
}
}
dest_uuid: "b1957c47155540b2b123544a1147f0b9"
cas_config_opid_index: -1
I20260807 19:55:48.299853 14431 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } }
I20260807 19:55:48.308107 15243 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 741c64d32b914d9b8e74c5a610aa2834 (127.5.197.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:48.309443 15156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:48.313161 15156 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Refusing update from remote peer b1957c47155540b2b123544a1147f0b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 19:55:48.319077 15243 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.5.197.189:41493
I20260807 19:55:48.320080 15095 master.cc:537] Master@127.5.197.189:41493 shutting down...
I20260807 19:55:48.319914 15242 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:48.321780 15246 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:48.322252 15246 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:48.331996 15095 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:48.332396 15095 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:48.332612 15095 tablet_replica.cc:330] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.188.keytab.
Entry for principal oryx/127.5.197.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.188.keytab.
I20260807 19:55:48.335711 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:41257
--webserver_interface=127.5.197.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.188.keytab
--principal=oryx/127.5.197.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:48.340272 14407 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260807 19:55:48.346009 15095 master.cc:552] Master@127.5.197.189:41493 shutdown complete.
I20260807 19:55:48.346179 15095 master_runner.cc:305] Clearing existing system tablet
I20260807 19:55:48.346728 15095 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:48.346890 15095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:48.352319 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.351802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45496)
0807 19:55:48.351983 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.352127 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:41493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 19:55:48.352797 14407 consensus_peers.cc:487] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 -> Peer 741c64d32b914d9b8e74c5a610aa2834 (127.5.197.189:41493): Couldn't send request to peer 741c64d32b914d9b8e74c5a610aa2834. Status: Network error: Client connection negotiation failed: client connection to 127.5.197.189:41493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 19:55:48.353636 15095 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:55:48.355072 15252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:48.355479 15095 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:48.356114 15095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 19:55:48.356208 15095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
uuid: "741c64d32b914d9b8e74c5a610aa2834"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "de4bc3296c2f31cc72609ebd884eafe5"
server_key_iv: "e25bf87afb508ddab129e4ca2b8f435a"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.359898 15095 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:48.364545 15095 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 19:55:48.364710 15095 log.cc:1196] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 19:55:48.365062 15095 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Deleting consensus metadata
I20260807 19:55:48.365288 15095 master_runner.cc:315] Copying system tablet from 127.5.197.190:45893
I20260807 19:55:48.367684 15095 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: tablet copy: Beginning tablet copy session from remote peer at address 127.5.197.190:45893
I20260807 19:55:48.379786 15200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.368447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37206 (local address 127.5.197.190:45893)
0807 19:55:48.368634 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.368640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.369029 (+ 389us) server_negotiation.cc:407] Connection header received
0807 19:55:48.369256 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.369260 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.369324 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.369407 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.370305 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.371028 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.372331 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.372772 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.372887 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.374691 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.374695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.374699 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.374729 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.377193 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.377818 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.377823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.377825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.377982 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.378357 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.378362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.378366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.378645 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.378780 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.379181 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.379383 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 19:55:48.379841 15265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.368436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37206)
0807 19:55:48.368930 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.368949 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.369085 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.369453 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.369458 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.369890 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.370133 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.370142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.371176 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.371181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.372188 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.372201 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.372935 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.372941 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.373115 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.373719 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.373736 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.374480 (+ 744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.377321 (+ 2841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.377327 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.377331 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.377700 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.378095 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.378100 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.378104 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.378254 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.378763 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.378767 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.378924 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.379046 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.379351 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":271,"threads_started":1}
I20260807 19:55:48.380908 14462 tablet_copy_service.cc:140] P b1957c47155540b2b123544a1147f0b9: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 741c64d32b914d9b8e74c5a610aa2834 ({username='oryx', principal='oryx/127.5.197.189@KRBTEST.COM'} at 127.0.0.1:37206)
I20260807 19:55:48.381244 14462 tablet_copy_service.cc:161] P b1957c47155540b2b123544a1147f0b9: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 741c64d32b914d9b8e74c5a610aa2834 at {username='oryx', principal='oryx/127.5.197.189@KRBTEST.COM'} at 127.0.0.1:37206: session id = 741c64d32b914d9b8e74c5a610aa2834-00000000000000000000000000000000
I20260807 19:55:48.384426 14462 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 19:55:48.386294 15095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 19:55:48.390961 15095 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: tablet copy: Starting download of 0 data blocks...
I20260807 19:55:48.391253 15095 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: tablet copy: Starting download of 1 WAL segments...
I20260807 19:55:48.393971 15095 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 19:55:48.397168 14462 tablet_copy_service.cc:342] P b1957c47155540b2b123544a1147f0b9: Request end of tablet copy session 741c64d32b914d9b8e74c5a610aa2834-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.197.189@KRBTEST.COM'} at 127.0.0.1:37206
I20260807 19:55:48.397336 14462 tablet_copy_service.cc:433] P b1957c47155540b2b123544a1147f0b9: ending tablet copy session 741c64d32b914d9b8e74c5a610aa2834-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 741c64d32b914d9b8e74c5a610aa2834
I20260807 19:55:48.410305 15095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:48.412945 15266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:48.413971 15267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:48.418630 15095 server_base.cc:1034] running on GCE node
W20260807 19:55:48.418700 15269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:48.419291 15095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:48.419945 15095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:48.421284 15095 hybrid_clock.cc:648] HybridClock initialized: now 1786132548421217 us; error 40 us; skew 500 ppm
I20260807 19:55:48.421514 15095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:48.423646 15095 init.cc:377] Logged in from keytab as oryx/127.5.197.189@KRBTEST.COM (short username oryx)
I20260807 19:55:48.432644 15095 webserver.cc:460] Webserver started at http://127.5.197.189:36613/ using document root <none> and password file <none>
I20260807 19:55:48.433017 15095 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:48.433104 15095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:48.436261 15095 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 19:55:48.438207 15278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:48.438639 15095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 19:55:48.438786 15095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
uuid: "741c64d32b914d9b8e74c5a610aa2834"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "de4bc3296c2f31cc72609ebd884eafe5"
server_key_iv: "e25bf87afb508ddab129e4ca2b8f435a"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.438958 15095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:48.473865 15095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:48.477927 15095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:48.504551 15095 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.189:41493
I20260807 19:55:48.504580 15352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.189:41493 every 8 connection(s)
I20260807 19:55:48.505800 15095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
I20260807 19:55:48.511143 15353 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:55:48.514842 15353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Bootstrap starting.
I20260807 19:55:48.533313 15353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:55:48.533979 15353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Bootstrap complete.
I20260807 19:55:48.535270 15353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } }
I20260807 19:55:48.535567 15353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 741c64d32b914d9b8e74c5a610aa2834, State: Initialized, Role: LEARNER
I20260807 19:55:48.535920 15353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } }
I20260807 19:55:48.536831 15356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:48.537127 15353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:48.537225 15356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: LEARNER
I20260807 19:55:48.554324 15374 catalog_manager.cc:1259] Loaded cluster ID: b742d50cc4bd435c950e305ee8ad1e27
I20260807 19:55:48.554450 15374 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: loading cluster ID for follower catalog manager: success
I20260807 19:55:48.558179 15374 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: acquiring CA information for follower catalog manager: success
I20260807 19:55:48.560962 15374 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:55:48.644145 15085 heartbeater.cc:503] Master 127.5.197.190:45893 was elected leader, sending a full tablet report...
W20260807 19:55:48.740478 15250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:48.740826 15250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:48.740968 15250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:48.748488 15250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:48.748615 15250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:48.748697 15250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:48.748777 15250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:48.748835 15250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:48.758905 15250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.188.keytab
--principal=oryx/127.5.197.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:41257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.197.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:48.760407 15250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:48.761754 15250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 19:55:48.773257 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.766413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45510)
0807 19:55:48.766622 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.766644 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.766792 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.767723 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.767729 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.767762 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:48.767966 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.767979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.769470 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.769476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.771074 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.771090 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.772364 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.772370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.772621 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.772689 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.772782 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.772945 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 19:55:48.773360 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.766624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45510 (local address 127.5.197.189:41493)
0807 19:55:48.767226 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.767232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.767261 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:55:48.767356 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.767362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.767473 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.768127 (+ 654us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:48.768310 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.769319 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.771241 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.772191 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.772338 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.772587 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.772905 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.773041 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":323,"threads_started":1}
W20260807 19:55:48.774696 15382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:48.774874 15381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:48.774930 15316 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
W20260807 19:55:48.775475 15386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:48.775882 15356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1957c47155540b2b123544a1147f0b9. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:48.776108 15356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: LEARNER
I20260807 19:55:48.777211 15250 server_base.cc:1034] running on GCE node
I20260807 19:55:48.778075 15250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:48.779490 15250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:48.780700 15250 hybrid_clock.cc:648] HybridClock initialized: now 1786132548780629 us; error 55 us; skew 500 ppm
I20260807 19:55:48.781096 15250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:48.784466 15250 init.cc:377] Logged in from keytab as oryx/127.5.197.188@KRBTEST.COM (short username oryx)
I20260807 19:55:48.785957 15250 webserver.cc:460] Webserver started at http://127.5.197.188:38995/ using document root <none> and password file <none>
I20260807 19:55:48.786648 15250 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:48.786768 15250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:48.787081 15250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:48.790241 15250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/instance:
uuid: "6ae7f7fe7c87449e93175f562542616d"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "aeec714ef8c61e932ab7dfc79342b989"
server_key_iv: "caf7856e717254c6cd8c4beb086425e1"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.791036 15250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal/instance:
uuid: "6ae7f7fe7c87449e93175f562542616d"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "aeec714ef8c61e932ab7dfc79342b989"
server_key_iv: "caf7856e717254c6cd8c4beb086425e1"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.796394 15250 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 19:55:48.799872 15395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:48.801213 15250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 19:55:48.801422 15250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
uuid: "6ae7f7fe7c87449e93175f562542616d"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "aeec714ef8c61e932ab7dfc79342b989"
server_key_iv: "caf7856e717254c6cd8c4beb086425e1"
server_key_version: "encryptionkey@0"
I20260807 19:55:48.801609 15250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:48.840389 15250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:48.844560 15250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:48.844841 15250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:48.863238 15250 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.188:41257
I20260807 19:55:48.863279 15469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.188:41257 every 8 connection(s)
I20260807 19:55:48.864692 15250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
I20260807 19:55:48.867305 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 15250
I20260807 19:55:48.868988 15470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:48.878697 15470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.188@KRBTEST.COM
I20260807 19:55:48.894765 15474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.869772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38914 (local address 127.5.197.188:41257)
0807 19:55:48.870656 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.870673 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.870729 (+ 56us) server_negotiation.cc:407] Connection header received
0807 19:55:48.872597 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.872628 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.873167 (+ 539us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.873622 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.875341 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.877385 (+ 2044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.879200 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.880243 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.880429 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.886605 (+ 6176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.886616 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.886634 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.886685 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.890467 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.891161 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.891169 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.891177 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.891414 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.891797 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.891802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.891805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.892439 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.892721 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.893202 (+ 481us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.893626 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":355,"threads_started":1}
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.188@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:48.901479 15478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.881855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37208 (local address 127.5.197.190:45893)
0807 19:55:48.887076 (+ 5221us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.887081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.887501 (+ 420us) server_negotiation.cc:407] Connection header received
0807 19:55:48.887778 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.887784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.887881 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.888002 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.889398 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.890469 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.892275 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.892841 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.892963 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.896385 (+ 3422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.896389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.896393 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.896426 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.899059 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.899789 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.899792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.899794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.899920 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.900220 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.900223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.900225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.900491 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.900597 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.901039 (+ 442us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.901204 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5110,"thread_start_us":5021,"threads_started":1}
I20260807 19:55:48.901486 15479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.881809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37208)
0807 19:55:48.887347 (+ 5538us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.887390 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.887552 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.888100 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.888107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.888934 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.889240 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.889249 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.890664 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.890667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.892076 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.892089 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.893037 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.893045 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.893305 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.893941 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.893958 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.896200 (+ 2242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.899203 (+ 3003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.899213 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.899218 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.899611 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.900005 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.900008 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.900010 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.900138 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.900607 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.900613 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.900776 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.900948 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.901206 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5323,"thread_start_us":4786,"threads_started":1}
I20260807 19:55:48.902962 15470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.188@KRBTEST.COM for oryx/127.5.197.189@KRBTEST.COM
I20260807 19:55:48.915333 15479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.903632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45520)
0807 19:55:48.903863 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.903883 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.903986 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.904413 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.904416 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.904764 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.904916 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.904927 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.905982 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.905986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.906936 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.906948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.907722 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.907727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.907852 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.908387 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.908406 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.910494 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.913287 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.913291 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.913294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.913686 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.913997 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.914000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.914002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.914126 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.914595 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.914598 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.914728 (+ 130us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.914842 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.915063 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 19:55:48.915359 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.903878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45520 (local address 127.5.197.189:41493)
0807 19:55:48.904083 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.904089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.904111 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:55:48.904170 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.904174 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.904243 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.904357 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.905055 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.905858 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.907083 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.907532 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.907630 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.910688 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.910694 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.910697 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.910732 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.913149 (+ 2417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.913779 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.913782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.913784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.913916 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.914206 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.914209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.914211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.914480 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.914608 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.914914 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.915099 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:55:48.916498 15470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:55:48 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132548, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.188@KRBTEST.COM for oryx/127.5.197.188@KRBTEST.COM
I20260807 19:55:48.928525 15479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.917295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.0.0.1:38916)
0807 19:55:48.917436 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.917451 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.917550 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.917813 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.917817 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.918177 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.918324 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.918333 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.919246 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.919251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.920134 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.920146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.920800 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.920806 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.920991 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.921544 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.921561 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.923483 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.926364 (+ 2881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.926368 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.926370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.926728 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.927086 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.927089 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.927091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.927244 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.927773 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.927777 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.927908 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.928019 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.928201 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 19:55:48.928700 15474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.917216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38916 (local address 127.5.197.188:41257)
0807 19:55:48.917386 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.917395 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.917507 (+ 112us) server_negotiation.cc:407] Connection header received
0807 19:55:48.917645 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.917650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.917707 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.917792 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.918451 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.919127 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.920262 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.920653 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.920766 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.923650 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.923654 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.923657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.923721 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.926241 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.926847 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.926851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.926853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.926981 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.927348 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.927351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.927354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.927650 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.927787 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.928150 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.928366 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 19:55:48.933421 15470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Bootstrap starting.
I20260807 19:55:48.936781 15470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:48.938181 15470 log.cc:824] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:48.941732 15470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: No bootstrap required, opened a new log
I20260807 19:55:48.950048 15470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } }
I20260807 19:55:48.950382 15470 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:48.950496 15470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ae7f7fe7c87449e93175f562542616d, State: Initialized, Role: FOLLOWER
I20260807 19:55:48.951088 15470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } }
I20260807 19:55:48.951977 15482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } } }
I20260807 19:55:48.952301 15482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:55:48.952989 15470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: configured and running, proceeding with master startup.
W20260807 19:55:48.961333 15500 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:55:48.961479 15500 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:55:48.966131 15250 master_runner.cc:428] Detected that this master 6ae7f7fe7c87449e93175f562542616d is joining an existing cluster
I20260807 19:55:48.966260 15250 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.197.188:41257
I20260807 19:55:48.989416 15507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.970448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.0.0.1:38932)
0807 19:55:48.973035 (+ 2587us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.973063 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.973225 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.973709 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.973714 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.974474 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.974893 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.974909 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.976509 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.976515 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.978238 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.978277 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.979714 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.979722 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.980002 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.980801 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.980825 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.981950 (+ 1125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.986414 (+ 4464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.986419 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.986423 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.986976 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.987426 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.987430 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.987433 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.987578 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.988299 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.988303 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.988486 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.988604 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.988900 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2459,"mutex_wait_us":58,"thread_start_us":1426,"threads_started":1}
I20260807 19:55:48.990350 15478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.970647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37210 (local address 127.5.197.190:45893)
0807 19:55:48.970868 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.970875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.972366 (+ 1491us) server_negotiation.cc:407] Connection header received
0807 19:55:48.972566 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.972572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.972661 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.972771 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.974393 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.975548 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.977740 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.978404 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.978508 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.983999 (+ 5491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.984006 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.984010 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.984055 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.987178 (+ 3123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.988025 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.988031 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.988034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.988187 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.988645 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.988650 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.988653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.989023 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.989159 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.989794 (+ 635us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.990014 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:55:48.990365 15474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.970260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38932 (local address 127.5.197.188:41257)
0807 19:55:48.970481 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.970488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.973139 (+ 2651us) server_negotiation.cc:407] Connection header received
0807 19:55:48.973376 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.973381 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.973444 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.973510 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.975053 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.976290 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.978417 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.979309 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.979437 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.982119 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.982125 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.982129 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.982179 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.986279 (+ 4100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.987102 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.987108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.987112 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.987294 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.987755 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.987760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.987763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.988162 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.989689 (+ 1527us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.989804 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.990006 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":74}
I20260807 19:55:48.991334 15508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.970356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37210)
0807 19:55:48.972228 (+ 1872us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.972250 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.972424 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.972975 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.972980 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.973770 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.974183 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.974199 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.975787 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.975792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.977552 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.977569 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.978818 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.978825 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.979924 (+ 1099us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.982395 (+ 2471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.982420 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.983768 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.987329 (+ 3561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.987334 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.987337 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.987886 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.988319 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.988323 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.988326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.988509 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.989245 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.989249 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.989467 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.990641 (+ 1174us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.990871 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1706,"mutex_wait_us":95,"thread_start_us":2343,"threads_started":1}
I20260807 19:55:48.996510 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.973363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45528 (local address 127.5.197.189:41493)
0807 19:55:48.973551 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.973557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.979565 (+ 6008us) server_negotiation.cc:407] Connection header received
0807 19:55:48.979728 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.979733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.979820 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.979916 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.981378 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.982468 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.984586 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.985228 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.985347 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.988392 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:48.988399 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:48.988404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:48.988445 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:48.992674 (+ 4229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.993931 (+ 1257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.993936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.993939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.994104 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:48.994836 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:48.994841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:48.994845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:48.995239 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:48.995391 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:48.995952 (+ 561us) server_negotiation.cc:299] Negotiation successful
0807 19:55:48.996193 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:55:48.996816 15509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.973681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45528)
0807 19:55:48.979447 (+ 5766us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.979466 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.979584 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.980124 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.980128 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.980832 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.981222 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.981235 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.982677 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.982683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.984401 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.984418 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.985654 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.985660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:48.985834 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:48.986547 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:48.986570 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:48.988117 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:48.993224 (+ 5107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.993232 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.993236 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.993773 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.994487 (+ 714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:48.994492 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:48.994496 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:48.994694 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:48.995376 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:48.995381 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:48.995608 (+ 227us) client_negotiation.cc:769] Sending connection context
0807 19:55:48.995806 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 19:55:48.996105 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5648,"spinlock_wait_cycles":44928,"thread_start_us":5498,"threads_started":1}
I20260807 19:55:49.000583 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 14516
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.190@KRBTEST.COM for oryx/127.5.197.188@KRBTEST.COM
I20260807 19:55:49.012594 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.996550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.0.0.1:38942)
0807 19:55:48.996946 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:48.996965 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:48.997071 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:48.997490 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:48.997495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:48.997957 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:48.998172 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:48.998186 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.999240 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:48.999246 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.000666 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.000683 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.001686 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.001692 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.001875 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.002464 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:49.002482 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:49.005311 (+ 2829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:49.009629 (+ 4318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.009634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.009639 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.010175 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.010634 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.010639 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.010643 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.010834 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.011530 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:49.011536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:49.011778 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 19:55:49.011938 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 19:55:49.012235 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261}
I20260807 19:55:49.012707 15474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:48.996943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38942 (local address 127.5.197.188:41257)
0807 19:55:48.997099 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:48.997104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:48.997123 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:55:48.997218 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:48.997223 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:48.997325 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:48.997434 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:48.998329 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:48.999097 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.000842 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.001510 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.001646 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.005549 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:49.005556 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:49.005564 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:49.005605 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:49.009478 (+ 3873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.010322 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.010328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.010332 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.010494 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.010971 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.010977 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.010980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.011392 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:49.011549 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.012087 (+ 538us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.012362 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.129@KRBTEST.COM
I20260807 19:55:49.014571 14431 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.5.197.188:41257: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6ae7f7fe7c87449e93175f562542616d"
member_type: NON_VOTER
last_known_addr {
host: "127.5.197.188"
port: 41257
}
attrs {
promote: true
}
}
dest_uuid: "b1957c47155540b2b123544a1147f0b9"
cas_config_opid_index: 5
I20260807 19:55:49.015626 14431 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } }
I20260807 19:55:49.017880 15242 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 6ae7f7fe7c87449e93175f562542616d (127.5.197.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.018607 15316 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 LEARNER]: Refusing update from remote peer b1957c47155540b2b123544a1147f0b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 19:55:49.020810 15430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:49.023767 15515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.002465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50720 (local address 127.5.197.129:35183)
0807 19:55:49.003180 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:49.003191 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:49.003223 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:55:49.003292 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:49.003301 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:49.003603 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:49.003904 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:49.005437 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.006713 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.008238 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.008897 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.009031 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.014272 (+ 5241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:49.014291 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:49.014311 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:49.014357 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:49.018770 (+ 4413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.019804 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.019815 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.019819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.020001 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.020563 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.020569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.020573 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.021190 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:49.022733 (+ 1543us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.022934 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.023281 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":327,"threads_started":1}
I20260807 19:55:49.025748 14703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:49.027529 15516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 19:55:49.030478 15316 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 6ae7f7fe7c87449e93175f562542616d (127.5.197.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.033540 15430 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 FOLLOWER]: Refusing update from remote peer b1957c47155540b2b123544a1147f0b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 19:55:49.034368 15356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.034633 15356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: LEARNER
I20260807 19:55:49.034586 15516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:49.035317 15242 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.5.197.188:41257
I20260807 19:55:49.036963 15250 master.cc:537] Master@127.5.197.188:41257 shutting down...
I20260807 19:55:49.057231 15430 raft_consensus.cc:858] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } }
W20260807 19:55:49.057717 15430 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } }
I20260807 19:55:49.058578 15516 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.058917 15516 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:49.068646 15242 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: attempting to promote NON_VOTER 741c64d32b914d9b8e74c5a610aa2834 to VOTER
I20260807 19:55:49.069591 15242 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } }
I20260807 19:55:49.074072 15521 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.074591 15521 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:49.086967 15430 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 741c64d32b914d9b8e74c5a610aa2834 (127.5.197.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:49.088590 15316 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 LEARNER]: Refusing update from remote peer b1957c47155540b2b123544a1147f0b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 19:55:49.089324 15516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 19:55:49.093988 15316 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 741c64d32b914d9b8e74c5a610aa2834 (127.5.197.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.098285 15356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.098555 15356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:55:49.099223 15516 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 741c64d32b914d9b8e74c5a610aa2834 (127.5.197.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.103173 15516 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.103456 15516 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:49.103998 15531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:49.104341 15531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 19:55:49.103475 15482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1957c47155540b2b123544a1147f0b9. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:49.104643 15482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 19:55:49.106058 15516 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.106335 15516 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:49.106675 15536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: NON_VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: true } } }
I20260807 19:55:49.106988 15536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 19:55:49.107916 15250 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260807 19:55:49.108394 15250 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260807 19:55:49.108584 15250 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: stopping tablet replica
W20260807 19:55:49.108562 14406 consensus_peers.cc:487] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 -> Peer 6ae7f7fe7c87449e93175f562542616d (127.5.197.188:41257): Couldn't send request to peer 6ae7f7fe7c87449e93175f562542616d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 19:55:49.116914 15250 master.cc:552] Master@127.5.197.188:41257 shutdown complete.
I20260807 19:55:49.117023 15250 master_runner.cc:305] Clearing existing system tablet
I20260807 19:55:49.117516 15250 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:49.117630 15250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:49.120645 15250 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 19:55:49.122324 15538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:49.122762 15250 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:49.123029 15250 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 19:55:49.123132 15250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
uuid: "6ae7f7fe7c87449e93175f562542616d"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "aeec714ef8c61e932ab7dfc79342b989"
server_key_iv: "caf7856e717254c6cd8c4beb086425e1"
server_key_version: "encryptionkey@0"
I20260807 19:55:49.128032 15250 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:49.134989 15250 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 19:55:49.135161 15250 log.cc:1196] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 19:55:49.135622 15250 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Deleting consensus metadata
I20260807 19:55:49.135921 15250 master_runner.cc:315] Copying system tablet from 127.5.197.190:45893
I20260807 19:55:49.145094 15250 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: tablet copy: Beginning tablet copy session from remote peer at address 127.5.197.190:45893
I20260807 19:55:49.161861 15478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.146329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37224 (local address 127.5.197.190:45893)
0807 19:55:49.146576 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:49.146583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:49.146757 (+ 174us) server_negotiation.cc:407] Connection header received
0807 19:55:49.147053 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:49.147059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:49.147165 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:49.147291 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:49.148441 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.149607 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.151618 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.152335 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.152478 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.154869 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:49.154876 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:49.154881 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:49.154925 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:49.158623 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.159483 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.159490 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.159493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.159657 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.160141 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.160146 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.160149 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.160557 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:49.160712 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.161235 (+ 523us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.161491 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260807 19:55:49.161881 15544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.145971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37224)
0807 19:55:49.146629 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:49.146650 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:49.146888 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:49.147325 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:49.147329 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:49.147929 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:49.148269 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.148283 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.149772 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.149778 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.151439 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.151460 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.152514 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.152521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.152691 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.153460 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:49.153504 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:49.154581 (+ 1077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:49.158781 (+ 4200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.158790 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.158795 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.159343 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.159828 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.159834 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.159838 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.160026 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.160715 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:49.160720 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:49.160953 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 19:55:49.161117 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 19:55:49.161449 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":617,"threads_started":1}
I20260807 19:55:49.162825 14462 tablet_copy_service.cc:140] P b1957c47155540b2b123544a1147f0b9: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6ae7f7fe7c87449e93175f562542616d ({username='oryx', principal='oryx/127.5.197.188@KRBTEST.COM'} at 127.0.0.1:37224)
I20260807 19:55:49.163000 14462 tablet_copy_service.cc:161] P b1957c47155540b2b123544a1147f0b9: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6ae7f7fe7c87449e93175f562542616d at {username='oryx', principal='oryx/127.5.197.188@KRBTEST.COM'} at 127.0.0.1:37224: session id = 6ae7f7fe7c87449e93175f562542616d-00000000000000000000000000000000
I20260807 19:55:49.167335 14462 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 19:55:49.168111 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 14516
I20260807 19:55:49.169404 15250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 19:55:49.176676 15250 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: tablet copy: Starting download of 0 data blocks...
I20260807 19:55:49.177008 15250 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: tablet copy: Starting download of 1 WAL segments...
I20260807 19:55:49.179909 15250 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 19:55:49.184450 14462 tablet_copy_service.cc:342] P b1957c47155540b2b123544a1147f0b9: Request end of tablet copy session 6ae7f7fe7c87449e93175f562542616d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.197.188@KRBTEST.COM'} at 127.0.0.1:37224
I20260807 19:55:49.184604 14462 tablet_copy_service.cc:433] P b1957c47155540b2b123544a1147f0b9: ending tablet copy session 6ae7f7fe7c87449e93175f562542616d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6ae7f7fe7c87449e93175f562542616d
I20260807 19:55:49.196509 15250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:49.199482 15545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:49.202080 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:35183
--local_ip_for_outbound_sockets=127.5.197.129
--tserver_master_addrs=127.5.197.190:45893
--webserver_port=37829
--webserver_interface=127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab
--principal=oryx/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:49.202500 15546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:49.209474 15549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:49.216949 15250 server_base.cc:1034] running on GCE node
I20260807 19:55:49.217401 15250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:49.218128 15250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:49.219338 15250 hybrid_clock.cc:648] HybridClock initialized: now 1786132549219293 us; error 40 us; skew 500 ppm
I20260807 19:55:49.219614 15250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132549, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:49.221989 15250 init.cc:377] Logged in from keytab as oryx/127.5.197.188@KRBTEST.COM (short username oryx)
I20260807 19:55:49.224725 15250 webserver.cc:460] Webserver started at http://127.5.197.188:45223/ using document root <none> and password file <none>
I20260807 19:55:49.225083 15250 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:49.225250 15250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:49.228683 15250 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 19:55:49.230844 15561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:49.231604 15250 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 19:55:49.231760 15250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
uuid: "6ae7f7fe7c87449e93175f562542616d"
format_stamp: "Formatted at 2026-08-07 19:55:48 on dist-test-slave-6bbx"
server_key: "aeec714ef8c61e932ab7dfc79342b989"
server_key_iv: "caf7856e717254c6cd8c4beb086425e1"
server_key_version: "encryptionkey@0"
I20260807 19:55:49.231969 15250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:49.268926 15250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:49.273422 15250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:49.310773 15250 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.188:41257
I20260807 19:55:49.310842 15637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.188:41257 every 8 connection(s)
I20260807 19:55:49.311918 15250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
I20260807 19:55:49.317723 15638 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:55:49.321993 15638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Bootstrap starting.
I20260807 19:55:49.340001 15638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:55:49.340603 15638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: Bootstrap complete.
I20260807 19:55:49.341847 15638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } }
I20260807 19:55:49.342207 15638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6ae7f7fe7c87449e93175f562542616d, State: Initialized, Role: LEARNER
I20260807 19:55:49.342485 15638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } }
I20260807 19:55:49.343382 15641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.343771 15638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:49.343966 15641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: LEARNER
I20260807 19:55:49.355849 15659 catalog_manager.cc:1259] Loaded cluster ID: b742d50cc4bd435c950e305ee8ad1e27
I20260807 19:55:49.355983 15659 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: loading cluster ID for follower catalog manager: success
I20260807 19:55:49.359732 15659 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: acquiring CA information for follower catalog manager: success
I20260807 19:55:49.362483 15659 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 19:55:49.587925 15552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:49.588243 15552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:49.588395 15552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:49.595935 15552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:49.596067 15552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:49.596230 15552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:49.606227 15552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab
--principal=oryx/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:35183
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=37829
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:49.607811 15552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:49.609185 15552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:49.623540 15666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:49.623499 15668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:49.623466 15672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:49.624444 15552 server_base.cc:1034] running on GCE node
I20260807 19:55:49.625072 15552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:49.626048 15552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:49.627297 15552 hybrid_clock.cc:648] HybridClock initialized: now 1786132549627226 us; error 50 us; skew 500 ppm
I20260807 19:55:49.627641 15552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132549, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:49.630791 15552 init.cc:377] Logged in from keytab as oryx/127.5.197.129@KRBTEST.COM (short username oryx)
I20260807 19:55:49.632341 15552 webserver.cc:460] Webserver started at http://127.5.197.129:37829/ using document root <none> and password file <none>
I20260807 19:55:49.633073 15552 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:49.633200 15552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:49.638993 15552 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 19:55:49.642024 15683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:49.643440 15552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:49.643605 15552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "480eb59f7269473b8b88b1565af9baaa"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "d34e680fc67b7e8115da6d02037b6844"
server_key_iv: "7927f663150ddaead08e926178473817"
server_key_version: "encryptionkey@0"
I20260807 19:55:49.644730 15552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:49.661305 15552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:49.666059 15552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:49.666378 15552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:49.667618 15552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:49.669214 15552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:49.669312 15552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:49.669423 15552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:49.669515 15552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:49.669746 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.663181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.0.0.1:38950)
0807 19:55:49.663638 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:49.663659 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:49.663845 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:49.664254 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:49.664260 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:49.664292 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:49.664521 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.664534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.665808 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.665814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.667750 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.667767 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.668984 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.668990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.669173 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.669209 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:55:49.669308 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 19:55:49.669446 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":221,"threads_started":1}
I20260807 19:55:49.669883 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.663423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38950 (local address 127.5.197.188:41257)
0807 19:55:49.663933 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:49.663937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:49.663955 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:55:49.664020 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:49.664023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:49.664092 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:49.664192 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:49.664689 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.665647 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.667943 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.668795 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.668947 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.669212 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.669373 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.669526 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":266,"threads_started":1}
I20260807 19:55:49.670765 15604 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 19:55:49.671249 15641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1957c47155540b2b123544a1147f0b9. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:49.671542 15641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: LEARNER
I20260807 19:55:49.706771 15552 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:35183
I20260807 19:55:49.706840 15853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:35183 every 8 connection(s)
I20260807 19:55:49.708313 15552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:49.713160 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 15552
I20260807 19:55:49.713526 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 14718
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132549, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.188@KRBTEST.COM
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132549, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.189@KRBTEST.COM
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132549, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:49.747460 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.711382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:51155 (local address 127.5.197.188:41257)
0807 19:55:49.711600 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:49.711605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:49.719083 (+ 7478us) server_negotiation.cc:407] Connection header received
0807 19:55:49.722295 (+ 3212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:49.722303 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:49.722406 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:49.722483 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:49.726613 (+ 4130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.727908 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.733072 (+ 5164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.733835 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.733946 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.739654 (+ 5708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:49.739686 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:49.739691 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:49.739737 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:49.743213 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.744262 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.744267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.744271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.744456 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.745091 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.745097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.745100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.745482 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:49.745619 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.746718 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.746968 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 19:55:49 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.130@KRBTEST.COM
I20260807 19:55:49.749320 15863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.711965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.5.197.129:51155)
0807 19:55:49.718866 (+ 6901us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:49.718933 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:49.721840 (+ 2907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:49.723023 (+ 1183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:49.723037 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:49.724653 (+ 1616us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:49.725733 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.725766 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.728243 (+ 2477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.728249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.732878 (+ 4629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.732897 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.734414 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.734421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.734912 (+ 491us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.735843 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:49.735875 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:49.739322 (+ 3447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:49.743392 (+ 4070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.743402 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.743424 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.744085 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.744618 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.744622 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.744626 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.744940 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.745722 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:49.745730 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:49.746226 (+ 496us) client_negotiation.cc:769] Sending connection context
0807 19:55:49.747696 (+ 1470us) client_negotiation.cc:240] Negotiation successful
0807 19:55:49.748002 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6569,"mutex_wait_us":102,"thread_start_us":8092,"threads_started":1}
I20260807 19:55:49.749364 15867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.719806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:35855 (local address 127.5.197.189:41493)
0807 19:55:49.729075 (+ 9269us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:49.729082 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:49.729522 (+ 440us) server_negotiation.cc:407] Connection header received
0807 19:55:49.729600 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:49.729606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:49.729709 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:49.731100 (+ 1391us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:49.731320 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.732766 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.734982 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.735603 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.735809 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.740082 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:49.740155 (+ 73us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:49.740160 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:49.740204 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:49.744239 (+ 4035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.745141 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.745146 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.745150 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.745329 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.745815 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.745820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.745823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.746174 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:49.748132 (+ 1958us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.748285 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.748519 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9100,"thread_start_us":8691,"threads_started":1}
I20260807 19:55:49.749614 15869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.723533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.5.197.129:35855)
0807 19:55:49.729223 (+ 5690us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:49.729247 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:49.729408 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:49.729887 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:49.729892 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:49.730599 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:49.730941 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.730954 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.733026 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.733032 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.734797 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.734815 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.736059 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.736073 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.736285 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.736958 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:49.736983 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:49.739848 (+ 2865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:49.744415 (+ 4567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.744420 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.744424 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.744958 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.745475 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.745480 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.745484 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.745664 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.746344 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:49.746349 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:49.746504 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 19:55:49.746696 (+ 192us) client_negotiation.cc:240] Negotiation successful
0807 19:55:49.747452 (+ 756us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5553,"mutex_wait_us":89,"thread_start_us":5552,"threads_started":1}
I20260807 19:55:49.751153 15857 heartbeater.cc:347] Connected to a master server at 127.5.197.189:41493
I20260807 19:55:49.751183 15854 heartbeater.cc:347] Connected to a master server at 127.5.197.188:41257
I20260807 19:55:49.751562 15857 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:49.751566 15854 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:49.752104 15862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.711980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.129:49229)
0807 19:55:49.720526 (+ 8546us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:49.720548 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:49.721842 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:49.723022 (+ 1180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:49.723036 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:49.730262 (+ 7226us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:49.730595 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.730609 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.734628 (+ 4019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.734632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.736224 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:49.736239 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.737679 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.737686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:49.737934 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.738788 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:49.738811 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:49.742032 (+ 3221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:49.746473 (+ 4441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.746478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.746481 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.747021 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.748086 (+ 1065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:49.748092 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:49.748096 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:49.748252 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:49.749139 (+ 887us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:49.749143 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:49.749324 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 19:55:49.751302 (+ 1978us) client_negotiation.cc:240] Negotiation successful
0807 19:55:49.751622 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8375,"mutex_wait_us":71,"thread_start_us":6314,"threads_started":1}
I20260807 19:55:49.752420 15861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.711386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:49229 (local address 127.5.197.190:45893)
0807 19:55:49.718424 (+ 7038us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:49.718432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:49.721168 (+ 2736us) server_negotiation.cc:407] Connection header received
0807 19:55:49.722357 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:49.722363 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:49.722474 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:49.722583 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:49.730819 (+ 8236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.732149 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.736419 (+ 4270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.737157 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.737319 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.742312 (+ 4993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:49.742319 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:49.742324 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:49.742380 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:49.746288 (+ 3908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.747167 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.747173 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.747270 (+ 97us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.747496 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.748434 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.748439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.748442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.748850 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:49.749044 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.750597 (+ 1553us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.750859 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6896,"thread_start_us":6759,"threads_started":1}
I20260807 19:55:49.752548 15854 heartbeater.cc:511] Master 127.5.197.188:41257 requested a full tablet report, sending...
I20260807 19:55:49.753221 15857 heartbeater.cc:511] Master 127.5.197.189:41493 requested a full tablet report, sending...
I20260807 19:55:49.753332 15856 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45893
I20260807 19:55:49.753460 15856 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:49.753919 15856 heartbeater.cc:511] Master 127.5.197.190:45893 requested a full tablet report, sending...
I20260807 19:55:49.755076 14431 ts_manager.cc:194] Re-registered known tserver with Master: 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:49.755125 15303 ts_manager.cc:194] Registered new tserver with Master: 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:49.755125 15586 ts_manager.cc:194] Registered new tserver with Master: 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:49.756220 14431 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:49229
I20260807 19:55:49.758174 15866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:49.714548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.5.197.130:38761)
0807 19:55:49.734821 (+ 20273us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:49.734832 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:49.734864 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:55:49.734948 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:49.734958 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:49.735236 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:49.735416 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:49.737832 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.739621 (+ 1789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.741613 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:49.742597 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:49.742730 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:49.748901 (+ 6171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:49.748921 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:49.748940 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:49.748988 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:49.754953 (+ 5965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.755984 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.755995 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.755998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.756180 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:49.756648 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:49.756653 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:49.756656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:49.757039 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:49.757272 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:49.757620 (+ 348us) server_negotiation.cc:299] Negotiation successful
0807 19:55:49.757830 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19959,"thread_start_us":19768,"threads_started":1}
I20260807 19:55:49.759383 14894 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:49.843140 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 14718
I20260807 19:55:49.864673 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:38761
--local_ip_for_outbound_sockets=127.5.197.130
--tserver_master_addrs=127.5.197.190:45893
--webserver_port=41189
--webserver_interface=127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab
--principal=oryx/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:55:50.142175 15693 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: NON_VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: true } } }
I20260807 19:55:50.142619 15693 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:50.144317 15873 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: attempting to promote NON_VOTER 6ae7f7fe7c87449e93175f562542616d to VOTER
I20260807 19:55:50.144910 15873 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } }
I20260807 19:55:50.147174 15604 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 LEARNER]: Refusing update from remote peer b1957c47155540b2b123544a1147f0b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 19:55:50.147188 15316 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Refusing update from remote peer b1957c47155540b2b123544a1147f0b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 19:55:50.147833 15875 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 19:55:50.148308 15693 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 19:55:50.151043 15875 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6ae7f7fe7c87449e93175f562542616d (127.5.197.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.151724 15316 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6ae7f7fe7c87449e93175f562542616d (127.5.197.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.154886 15873 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.154929 15875 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.155196 15875 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:50.155193 15873 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:50.161383 15881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.161814 15881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:55:50.162009 15693 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.162266 15693 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:50.162739 15604 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6ae7f7fe7c87449e93175f562542616d (127.5.197.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.165520 15641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1957c47155540b2b123544a1147f0b9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:50.165804 15641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: FOLLOWER
W20260807 19:55:50.215052 15872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:50.215351 15872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:50.215498 15872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:50.222940 15872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:50.223062 15872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:50.223218 15872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:50.233062 15872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab
--principal=oryx/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:38761
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=41189
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:50.234431 15872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:50.235809 15872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:50.249069 15890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:50.249022 15889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:50.249310 15893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:50.250324 15872 server_base.cc:1034] running on GCE node
I20260807 19:55:50.250974 15872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:50.251920 15872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:50.253116 15872 hybrid_clock.cc:648] HybridClock initialized: now 1786132550253070 us; error 38 us; skew 500 ppm
I20260807 19:55:50.253412 15872 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:50 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:50.256564 15872 init.cc:377] Logged in from keytab as oryx/127.5.197.130@KRBTEST.COM (short username oryx)
I20260807 19:55:50.257853 15872 webserver.cc:460] Webserver started at http://127.5.197.130:41189/ using document root <none> and password file <none>
I20260807 19:55:50.258646 15872 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:50.258764 15872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:50.263901 15872 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:50.266428 15903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:50.267656 15872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:50.267834 15872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8"
format_stamp: "Formatted at 2026-08-07 19:55:46 on dist-test-slave-6bbx"
server_key: "e8854ba1c579d71bbe66d74c47f32843"
server_key_iv: "dde46fc2fdc8ea606ccfeb87a47b3faa"
server_key_version: "encryptionkey@0"
I20260807 19:55:50.268774 15872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:50.289976 15872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:50.293970 15872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:50.294219 15872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:50.295145 15872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:50.296687 15872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:50.296787 15872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:50.296890 15872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:50.296964 15872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:50.329746 15872 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:38761
I20260807 19:55:50.329828 16064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:38761 every 8 connection(s)
I20260807 19:55:50.331171 15872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:50.332494 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 15872
I20260807 19:55:50.332801 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 14905
Aug 07 19:55:50 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.131@KRBTEST.COM
I20260807 19:55:50.357962 16070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.334335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56150 (local address 127.5.197.131:37887)
0807 19:55:50.335741 (+ 1406us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:50.335749 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:50.335790 (+ 41us) server_negotiation.cc:407] Connection header received
0807 19:55:50.335868 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:50.335875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:50.336124 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:50.336300 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:50.338824 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.340610 (+ 1786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.342701 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.343619 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.343776 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:50.350327 (+ 6551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:50.350346 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:50.350363 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:50.350411 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:50.354454 (+ 4043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.355279 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.355287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.355291 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.355487 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.355949 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.355954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.355958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.356403 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:50.356723 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:50.357317 (+ 594us) server_negotiation.cc:299] Negotiation successful
0807 19:55:50.357572 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1221,"thread_start_us":1056,"threads_started":1}
I20260807 19:55:50.359601 15080 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 07 19:55:50 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.188@KRBTEST.COM
Aug 07 19:55:50 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.189@KRBTEST.COM
Aug 07 19:55:50 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:50.369833 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.335876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:50883 (local address 127.5.197.188:41257)
0807 19:55:50.348936 (+ 13060us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:50.348942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:50.349877 (+ 935us) server_negotiation.cc:407] Connection header received
0807 19:55:50.350017 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:50.350024 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:50.350108 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:50.350216 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:50.352870 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.354114 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.356739 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.357408 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.357511 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:50.362341 (+ 4830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:50.362348 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:50.362352 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:50.362393 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:50.365980 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.367002 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.367008 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.367012 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.367155 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.367719 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.367725 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.367728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.368082 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:50.368218 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:50.369233 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0807 19:55:50.369463 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12903,"thread_start_us":13149,"threads_started":1}
I20260807 19:55:50.370955 16073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.335134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.5.197.130:50883)
0807 19:55:50.349758 (+ 14624us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:50.349776 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:50.349909 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:50.350719 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:50.350733 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:50.351723 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:50.352642 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:50.352668 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.354346 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.354351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:50.356574 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:50.356588 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.357856 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.357864 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:50.358120 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:50.358783 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:50.358811 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:50.362067 (+ 3256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:50.366143 (+ 4076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:50.366152 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:50.366167 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:50.366855 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:50.367306 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:50.367311 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:50.367314 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:50.367562 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:50.368320 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:50.368328 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:50.368728 (+ 400us) client_negotiation.cc:769] Sending connection context
0807 19:55:50.369115 (+ 387us) client_negotiation.cc:240] Negotiation successful
0807 19:55:50.369588 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14496,"mutex_wait_us":49,"spinlock_wait_cycles":14208,"thread_start_us":14147,"threads_started":1}
I20260807 19:55:50.371583 16077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.335119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.5.197.130:55597)
0807 19:55:50.344671 (+ 9552us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:50.344723 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:50.347363 (+ 2640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:50.355065 (+ 7702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:50.355070 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:50.355498 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:50.355797 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:50.355811 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.358376 (+ 2565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.358381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:50.359967 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:50.359985 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.361077 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.361084 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:50.361288 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:50.361851 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:50.361872 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:50.364429 (+ 2557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:50.368809 (+ 4380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:50.368815 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:50.368819 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:50.369322 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:50.369756 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:50.369761 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:50.369765 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:50.369956 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:50.370616 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:50.370620 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:50.370782 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 19:55:50.370931 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 19:55:50.371195 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9242,"spinlock_wait_cycles":74624,"thread_start_us":8969,"threads_started":1}
I20260807 19:55:50.372145 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.335891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:55597 (local address 127.5.197.189:41493)
0807 19:55:50.354463 (+ 18572us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:50.354469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:50.354490 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:55:50.354550 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:50.354555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:50.354648 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:50.356156 (+ 1508us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:50.356355 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.357439 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.360192 (+ 2753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.360866 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.361616 (+ 750us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:50.364647 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:50.364654 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:50.364659 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:50.364707 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:50.368649 (+ 3942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.369484 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.369489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.369492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.369630 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.370106 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.370110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.370114 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.370479 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:50.370625 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:50.371073 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 19:55:50.371798 (+ 725us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18444,"thread_start_us":18335,"threads_started":1}
I20260807 19:55:50.372735 16065 heartbeater.cc:347] Connected to a master server at 127.5.197.188:41257
I20260807 19:55:50.372910 16067 heartbeater.cc:347] Connected to a master server at 127.5.197.189:41493
I20260807 19:55:50.373095 16067 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:50.373137 16065 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:50.374042 16065 heartbeater.cc:511] Master 127.5.197.188:41257 requested a full tablet report, sending...
I20260807 19:55:50.375044 16067 heartbeater.cc:511] Master 127.5.197.189:41493 requested a full tablet report, sending...
I20260807 19:55:50.376295 15303 ts_manager.cc:194] Registered new tserver with Master: 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761)
I20260807 19:55:50.376312 15586 ts_manager.cc:194] Registered new tserver with Master: 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761)
I20260807 19:55:50.376499 16085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.350156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.130:54359)
0807 19:55:50.354816 (+ 4660us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:50.354833 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:50.354959 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:50.356019 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:50.356023 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:50.356611 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:50.356917 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:50.356931 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.359251 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.359256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:50.361867 (+ 2611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:50.361883 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.365493 (+ 3610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.365500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:50.365679 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:50.366184 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:50.366204 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:50.368911 (+ 2707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:50.373730 (+ 4819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:50.373738 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:50.373741 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:50.374213 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:50.374660 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:50.374665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:50.374673 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:50.374839 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:50.375572 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:50.375577 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:50.375756 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 19:55:50.375883 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 19:55:50.376138 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4525,"thread_start_us":4583,"threads_started":1}
I20260807 19:55:50.377749 16081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.345648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:54359 (local address 127.5.197.190:45893)
0807 19:55:50.353198 (+ 7550us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:50.353204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:50.354932 (+ 1728us) server_negotiation.cc:407] Connection header received
0807 19:55:50.355791 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:50.355797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:50.355885 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:50.355996 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:50.357593 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.358590 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.364904 (+ 6314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.365310 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.365421 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:50.369143 (+ 3722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:50.369151 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:50.369162 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:50.369214 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:50.372953 (+ 3739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.374345 (+ 1392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.374351 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.374355 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.374523 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:50.374949 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:50.374954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:50.374958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:50.375380 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:50.376942 (+ 1562us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:50.377089 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 19:55:50.377351 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7426,"thread_start_us":7307,"threads_started":1}
I20260807 19:55:50.378600 16066 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45893
I20260807 19:55:50.378729 16066 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:50.379168 16066 heartbeater.cc:511] Master 127.5.197.190:45893 requested a full tablet report, sending...
I20260807 19:55:50.380131 14431 ts_manager.cc:194] Re-registered known tserver with Master: 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761)
I20260807 19:55:50.380981 14431 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:54359
I20260807 19:55:50.460188 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 14905
I20260807 19:55:50.483026 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:37887
--local_ip_for_outbound_sockets=127.5.197.131
--tserver_master_addrs=127.5.197.190:45893
--webserver_port=34199
--webserver_interface=127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab
--principal=oryx/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:55:50.758862 15856 heartbeater.cc:503] Master 127.5.197.190:45893 was elected leader, sending a full tablet report...
W20260807 19:55:50.835253 16089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:50.835575 16089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:50.835757 16089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:50.843469 16089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:50.843604 16089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:50.843802 16089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:50.854192 16089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab
--principal=oryx/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:37887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=34199
--tserver_master_addrs=127.5.197.190:45893,127.5.197.189:41493,127.5.197.188:41257
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:50.855659 16089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:50.857060 16089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:50.870491 16098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:50.870460 16099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:50.871488 16089 server_base.cc:1034] running on GCE node
W20260807 19:55:50.876261 16101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:50.877063 16089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:50.878170 16089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:50.879410 16089 hybrid_clock.cc:648] HybridClock initialized: now 1786132550879343 us; error 57 us; skew 500 ppm
I20260807 19:55:50.879823 16089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:50 dist-test-slave-6bbx krb5kdc[14357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:50.883113 16089 init.cc:377] Logged in from keytab as oryx/127.5.197.131@KRBTEST.COM (short username oryx)
I20260807 19:55:50.884711 16089 webserver.cc:460] Webserver started at http://127.5.197.131:34199/ using document root <none> and password file <none>
I20260807 19:55:50.885458 16089 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:50.885601 16089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:50.891369 16089 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:55:50.894419 16112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:50.895913 16089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:55:50.896080 16089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "adddd87259a44c0ea76e067c17e492d7"
format_stamp: "Formatted at 2026-08-07 19:55:47 on dist-test-slave-6bbx"
server_key: "3c29a0fc5721546384ff80db854b0344"
server_key_iv: "c69b83312a8158b0925d7deaff22b606"
server_key_version: "encryptionkey@0"
I20260807 19:55:50.897111 16089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:50.942533 16089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:50.947082 16089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:50.947371 16089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:50.948531 16089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:55:50.950187 16089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:50.950289 16089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:50.950409 16089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:50.950485 16089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:50.982657 16089 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:37887
I20260807 19:55:50.982709 16289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:37887 every 8 connection(s)
I20260807 19:55:50.984151 16089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:50.990346 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 16089
Aug 07 19:55:51 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.188@KRBTEST.COM
Aug 07 19:55:51 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
Aug 07 19:55:51 dist-test-slave-6bbx krb5kdc[14357](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132550, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.189@KRBTEST.COM
I20260807 19:55:51.017187 16297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.987819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:55469 (local address 127.5.197.188:41257)
0807 19:55:50.989969 (+ 2150us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:50.989975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:50.989999 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:55:50.992608 (+ 2609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:50.992614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:50.992709 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:50.992814 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:50.996357 (+ 3543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.997662 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.000532 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.001274 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.001410 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.007330 (+ 5920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.007337 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.007342 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.007388 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.011797 (+ 4409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.012943 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.012950 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.012954 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.013138 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.013734 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.013751 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.013756 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.014145 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.014287 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.016378 (+ 2091us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.016658 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2025,"thread_start_us":1923,"threads_started":1}
I20260807 19:55:51.022274 16298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.987741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.5.197.131:55469)
0807 19:55:50.988634 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:50.988678 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:50.992428 (+ 3750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:50.995061 (+ 2633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:50.995067 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:50.995537 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:50.996089 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:50.996122 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:50.997920 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:50.997926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.000313 (+ 2387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.000332 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.001765 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.001774 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.002138 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.003039 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:51.003071 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:51.007009 (+ 3938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:51.012016 (+ 5007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:51.012027 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:51.012051 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:51.012774 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:51.013278 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:51.013283 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:51.013288 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:51.013585 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:51.014375 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:51.014386 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:51.014961 (+ 575us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.015298 (+ 337us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.015968 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":1,"spinlock_wait_cycles":25856,"thread_start_us":360,"threads_started":1}
I20260807 19:55:51.024164 16290 heartbeater.cc:347] Connected to a master server at 127.5.197.188:41257
I20260807 19:55:51.024528 16290 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:51.025520 16290 heartbeater.cc:511] Master 127.5.197.188:41257 requested a full tablet report, sending...
I20260807 19:55:51.026229 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.989838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:33951 (local address 127.5.197.189:41493)
0807 19:55:50.990363 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:50.990369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:50.999533 (+ 9164us) server_negotiation.cc:407] Connection header received
0807 19:55:51.000038 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.000045 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.000137 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.000219 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.001682 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.002870 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.004987 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.005627 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.005730 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.018075 (+ 12345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.018083 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.018089 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.018136 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.021733 (+ 3597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.023053 (+ 1320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.023058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.023061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.023237 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.024074 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.024079 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.024082 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.024465 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.024633 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.025639 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.025870 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":443,"threads_started":1}
I20260807 19:55:51.027294 16303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.990173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.5.197.131:33951)
0807 19:55:50.999409 (+ 9236us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:50.999430 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:50.999857 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:51.000473 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:51.000478 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:51.001167 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:51.001491 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.001504 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.003108 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.003113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.004814 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.004833 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.012169 (+ 7336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.012177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.012412 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.013451 (+ 1039us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:51.013479 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:51.017048 (+ 3569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:51.021889 (+ 4841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:51.021893 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:51.021897 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:51.022466 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:51.023427 (+ 961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:51.023432 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:51.023436 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:51.023611 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:51.024738 (+ 1127us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:51.024742 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:51.024913 (+ 171us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.026615 (+ 1702us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.026921 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9081,"thread_start_us":9390,"threads_started":1}
I20260807 19:55:51.027768 15586 ts_manager.cc:194] Registered new tserver with Master: adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887)
I20260807 19:55:51.028285 16293 heartbeater.cc:347] Connected to a master server at 127.5.197.189:41493
I20260807 19:55:51.028437 16293 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:51.028932 16293 heartbeater.cc:511] Master 127.5.197.189:41493 requested a full tablet report, sending...
I20260807 19:55:51.029326 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.987041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:42237 (local address 127.5.197.190:45893)
0807 19:55:50.987534 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:50.987541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:50.989887 (+ 2346us) server_negotiation.cc:407] Connection header received
0807 19:55:50.992363 (+ 2476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:50.992371 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:50.992480 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:50.992608 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.000749 (+ 8141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.001878 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.003885 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.004568 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.004696 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.011085 (+ 6389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.011093 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.011099 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.011149 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.015449 (+ 4300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.021735 (+ 6286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.021741 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.021744 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.021942 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.022639 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.022646 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.022650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.027144 (+ 4494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.027324 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.028622 (+ 1298us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.028905 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":232,"threads_started":1}
I20260807 19:55:51.030177 15303 ts_manager.cc:194] Registered new tserver with Master: adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887)
I20260807 19:55:51.031021 16299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.987741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:42237)
0807 19:55:50.989482 (+ 1741us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:50.989505 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:50.991998 (+ 2493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:50.993297 (+ 1299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:50.993311 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:50.994349 (+ 1038us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:51.000600 (+ 6251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.000613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.002005 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.002010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.003743 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.003760 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.004874 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.004881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.005972 (+ 1091us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.006860 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:51.006883 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:51.010846 (+ 3963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:51.020949 (+ 10103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:51.020955 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:51.020959 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:51.021606 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:51.022051 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:51.022056 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:51.022059 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:51.022260 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:51.028065 (+ 5805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:51.028070 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:51.028255 (+ 185us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.028407 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.028712 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1560,"mutex_wait_us":4922,"thread_start_us":1234,"threads_started":1}
I20260807 19:55:51.031934 16292 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45893
I20260807 19:55:51.032079 16292 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:51.032593 16292 heartbeater.cc:511] Master 127.5.197.190:45893 requested a full tablet report, sending...
I20260807 19:55:51.033900 14431 ts_manager.cc:194] Re-registered known tserver with Master: adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887)
I20260807 19:55:51.035101 14431 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:42237
I20260807 19:55:51.045218 16297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.996514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38958 (local address 127.5.197.188:41257)
0807 19:55:51.017524 (+ 21010us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.017530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.017550 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:55:51.018057 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.018063 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.018162 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.018252 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.024152 (+ 5900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.025409 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.031104 (+ 5695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.031983 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.032078 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.037800 (+ 5722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.037808 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.037812 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.037857 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.041931 (+ 4074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.042856 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.042861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.042865 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.043014 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.043472 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.043477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.043479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.043909 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.044150 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.044553 (+ 403us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.044804 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20889,"thread_start_us":21177,"threads_started":1}
I20260807 19:55:51.048640 16310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:50.995929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.5.197.190:45893)
0807 19:55:51.026857 (+ 30928us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.026863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.026882 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:55:51.026933 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.026938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.027019 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.027122 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.030167 (+ 3045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.031256 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.033754 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.034385 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.034498 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.040007 (+ 5509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.040014 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.040018 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.040059 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.043483 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.044277 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.044283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.044286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.044439 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.046742 (+ 2303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.046747 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.046751 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.047103 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.047357 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.047646 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.048224 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30824,"thread_start_us":30683,"threads_started":1}
I20260807 19:55:51.048842 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.006087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45538 (local address 127.5.197.189:41493)
0807 19:55:51.026546 (+ 20459us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.026552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.033578 (+ 7026us) server_negotiation.cc:407] Connection header received
0807 19:55:51.034153 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.034159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.034258 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.034626 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.036615 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.037398 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.039288 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.040052 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.040168 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.042685 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.042690 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.042693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.042725 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.046018 (+ 3293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.046817 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.046821 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.046823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.046943 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.047319 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.047324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.047327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.047728 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.048019 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.048301 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.048479 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20367,"thread_start_us":27202,"threads_started":1}
I20260807 19:55:51.053051 14431 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:51.060072 14431 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:51.094732 16330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.078358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:37887 (local address 127.0.0.1:56154)
0807 19:55:51.079413 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:51.079434 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:51.079564 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:51.085338 (+ 5774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:51.085343 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:51.085378 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:51.085846 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.085860 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.088797 (+ 2937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.088804 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.091215 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.091243 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.093790 (+ 2547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.093797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.094017 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.094056 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.094153 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.094326 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"thread_start_us":1337,"threads_started":1}
I20260807 19:55:51.096264 16332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.079270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56154 (local address 127.5.197.131:37887)
0807 19:55:51.084147 (+ 4877us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.084158 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.084198 (+ 40us) server_negotiation.cc:407] Connection header received
0807 19:55:51.084335 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.084345 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.084668 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.084986 (+ 318us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:51.086133 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.088012 (+ 1879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.091458 (+ 3446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.093224 (+ 1766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.093378 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.093639 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.095810 (+ 2171us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.096010 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4698,"thread_start_us":4513,"threads_started":1}
I20260807 19:55:51.104768 16190 tablet_service.cc:1467] Processing CreateTablet for tablet 854b984b38e04d3e83481a914b724970 (DEFAULT_TABLE table=test-table [id=3999515d71ec40ffbd38ff72f734099c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:51.106465 16190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 854b984b38e04d3e83481a914b724970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:51.107275 16337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.080772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.5.197.129:35183)
0807 19:55:51.099436 (+ 18664us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.099443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.099470 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:55:51.099566 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.099572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.099898 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.100502 (+ 604us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:51.101152 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.102554 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.104596 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.106182 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.106347 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.106668 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.106795 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.106962 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18463,"thread_start_us":18346,"threads_started":1}
I20260807 19:55:51.107290 16333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.080040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:35183 (local address 127.0.0.1:50724)
0807 19:55:51.095716 (+ 15676us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:51.095739 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:51.095848 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:51.100502 (+ 4654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:51.100507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:51.100533 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:51.100956 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.100974 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.102725 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.102729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.104410 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.104426 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.106419 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.106426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.106598 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.106634 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.106739 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.106897 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15530,"thread_start_us":20120,"threads_started":1}
I20260807 19:55:51.107564 16330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.079541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38761 (local address 127.0.0.1:44002)
0807 19:55:51.095026 (+ 15485us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:51.095050 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:51.095164 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:51.101643 (+ 6479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:51.101648 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:51.101677 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:51.101886 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.101898 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.103649 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.103655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.105262 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.105278 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.106881 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.106886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.107067 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.107102 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.107165 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.107302 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15348,"thread_start_us":15858,"threads_started":1}
I20260807 19:55:51.108670 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.079867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44002 (local address 127.5.197.130:38761)
0807 19:55:51.101078 (+ 21211us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.101087 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.101116 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:55:51.101224 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.101230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.101407 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.101676 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:51.102043 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.103497 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.105451 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.106721 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.107989 (+ 1268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.108165 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.108230 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.108398 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21035,"thread_start_us":20930,"threads_started":1}
I20260807 19:55:51.111181 15764 tablet_service.cc:1467] Processing CreateTablet for tablet 854b984b38e04d3e83481a914b724970 (DEFAULT_TABLE table=test-table [id=3999515d71ec40ffbd38ff72f734099c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:51.112358 15977 tablet_service.cc:1467] Processing CreateTablet for tablet 854b984b38e04d3e83481a914b724970 (DEFAULT_TABLE table=test-table [id=3999515d71ec40ffbd38ff72f734099c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:51.112921 15764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 854b984b38e04d3e83481a914b724970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:51.113730 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 854b984b38e04d3e83481a914b724970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:51.123025 16338 tablet_bootstrap.cc:492] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Bootstrap starting.
I20260807 19:55:51.127080 16338 tablet_bootstrap.cc:654] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:51.128014 16340 tablet_bootstrap.cc:492] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Bootstrap starting.
I20260807 19:55:51.128840 16338 log.cc:824] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:51.129282 16341 tablet_bootstrap.cc:492] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Bootstrap starting.
I20260807 19:55:51.131860 16340 tablet_bootstrap.cc:654] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:51.132638 16338 tablet_bootstrap.cc:492] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: No bootstrap required, opened a new log
I20260807 19:55:51.132822 16341 tablet_bootstrap.cc:654] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:51.132939 16338 ts_tablet_manager.cc:1397] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260807 19:55:51.133255 16340 log.cc:824] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:51.134164 16341 log.cc:824] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:51.139087 16341 tablet_bootstrap.cc:492] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: No bootstrap required, opened a new log
I20260807 19:55:51.139076 16340 tablet_bootstrap.cc:492] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: No bootstrap required, opened a new log
I20260807 19:55:51.139408 16340 ts_tablet_manager.cc:1397] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 19:55:51.139410 16341 ts_tablet_manager.cc:1397] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260807 19:55:51.141947 16338 raft_consensus.cc:348] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.142375 16338 raft_consensus.cc:374] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:51.142477 16338 raft_consensus.cc:729] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adddd87259a44c0ea76e067c17e492d7, State: Initialized, Role: FOLLOWER
I20260807 19:55:51.143101 16338 consensus_queue.cc:260] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.144991 16338 ts_tablet_manager.cc:1428] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Time spent starting tablet: real 0.012s user 0.006s sys 0.006s
I20260807 19:55:51.145298 16292 heartbeater.cc:503] Master 127.5.197.190:45893 was elected leader, sending a full tablet report...
I20260807 19:55:51.150175 16340 raft_consensus.cc:348] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.150175 16341 raft_consensus.cc:348] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.150665 16340 raft_consensus.cc:374] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:51.150658 16341 raft_consensus.cc:374] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:51.150765 16340 raft_consensus.cc:729] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c1aea78ab048b0bce1ebb92c0c9fa8, State: Initialized, Role: FOLLOWER
I20260807 19:55:51.150774 16341 raft_consensus.cc:729] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 480eb59f7269473b8b88b1565af9baaa, State: Initialized, Role: FOLLOWER
I20260807 19:55:51.151446 16340 consensus_queue.cc:260] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.151408 16341 consensus_queue.cc:260] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.153501 16341 ts_tablet_manager.cc:1428] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260807 19:55:51.156780 16066 heartbeater.cc:503] Master 127.5.197.190:45893 was elected leader, sending a full tablet report...
I20260807 19:55:51.157559 16340 ts_tablet_manager.cc:1428] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Time spent starting tablet: real 0.018s user 0.008s sys 0.011s
I20260807 19:55:51.160344 16349 raft_consensus.cc:482] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:51.160739 16349 raft_consensus.cc:504] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.162629 16349 leader_election.cc:288] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887), 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:51.169150 16332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.163047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:51549 (local address 127.5.197.131:37887)
0807 19:55:51.163273 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.163279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.163596 (+ 317us) server_negotiation.cc:407] Connection header received
0807 19:55:51.163898 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.163904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.163967 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.164040 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:51.164706 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.165631 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.167407 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.168259 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.168415 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.168498 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.168769 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.168911 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 19:55:51.169499 16337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.163730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:40529 (local address 127.5.197.129:35183)
0807 19:55:51.163924 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.163930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.164237 (+ 307us) server_negotiation.cc:407] Connection header received
0807 19:55:51.164455 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.164460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.164534 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.164626 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:51.165156 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.166093 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.167837 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.168610 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.168763 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.168834 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.169121 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.169248 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 19:55:51.169519 16350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.162877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:37887 (local address 127.5.197.130:51549)
0807 19:55:51.163498 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:51.163518 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:51.163751 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:51.164077 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:51.164082 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:51.164113 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:51.164536 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.164550 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.165818 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.165822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.167244 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.167257 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.168471 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.168477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.168621 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.168646 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.168727 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.168883 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"spinlock_wait_cycles":25472,"thread_start_us":333,"threads_started":1}
I20260807 19:55:51.169622 16353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.163561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:35183 (local address 127.5.197.130:40529)
0807 19:55:51.164128 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:51.164144 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:51.164315 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:51.164659 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:51.164663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:51.164687 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:51.164996 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.165005 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.166239 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.166246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.167645 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:51.167658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.168824 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.168830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:51.168974 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.168997 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 19:55:51.169077 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 19:55:51.169206 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"spinlock_wait_cycles":896,"thread_start_us":379,"threads_started":1}
I20260807 19:55:51.170516 16220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854b984b38e04d3e83481a914b724970" candidate_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adddd87259a44c0ea76e067c17e492d7" is_pre_election: true
I20260807 19:55:51.170585 15794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854b984b38e04d3e83481a914b724970" candidate_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "480eb59f7269473b8b88b1565af9baaa" is_pre_election: true
I20260807 19:55:51.171028 16220 raft_consensus.cc:2454] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41c1aea78ab048b0bce1ebb92c0c9fa8 in term 0.
I20260807 19:55:51.171047 15794 raft_consensus.cc:2454] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41c1aea78ab048b0bce1ebb92c0c9fa8 in term 0.
I20260807 19:55:51.171646 15910 leader_election.cc:302] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c1aea78ab048b0bce1ebb92c0c9fa8, 480eb59f7269473b8b88b1565af9baaa; no voters:
I20260807 19:55:51.172117 16349 raft_consensus.cc:2781] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:51.172260 16349 raft_consensus.cc:482] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:51.172370 16349 raft_consensus.cc:3037] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:51.174743 16349 raft_consensus.cc:504] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.175349 16349 leader_election.cc:288] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [CANDIDATE]: Term 1 election: Requested vote from peers adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887), 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:51.175889 16220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854b984b38e04d3e83481a914b724970" candidate_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adddd87259a44c0ea76e067c17e492d7"
I20260807 19:55:51.175911 15794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854b984b38e04d3e83481a914b724970" candidate_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "480eb59f7269473b8b88b1565af9baaa"
I20260807 19:55:51.176091 16220 raft_consensus.cc:3037] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:51.176096 15794 raft_consensus.cc:3037] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:51.178279 15794 raft_consensus.cc:2454] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c1aea78ab048b0bce1ebb92c0c9fa8 in term 1.
I20260807 19:55:51.178328 16220 raft_consensus.cc:2454] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c1aea78ab048b0bce1ebb92c0c9fa8 in term 1.
I20260807 19:55:51.178679 15910 leader_election.cc:302] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c1aea78ab048b0bce1ebb92c0c9fa8, 480eb59f7269473b8b88b1565af9baaa; no voters:
I20260807 19:55:51.178966 16349 raft_consensus.cc:2781] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:51.179481 16349 raft_consensus.cc:686] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 LEADER]: Becoming Leader. State: Replica: 41c1aea78ab048b0bce1ebb92c0c9fa8, State: Running, Role: LEADER
I20260807 19:55:51.180029 16349 consensus_queue.cc:237] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:51.186021 14427 catalog_manager.cc:5495] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } health_report { overall_health: UNKNOWN } } }
W20260807 19:55:51.213330 15859 tablet.cc:2369] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:51.222771 16334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.217726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.5.197.130:38761)
0807 19:55:51.217940 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.217945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.218019 (+ 74us) server_negotiation.cc:407] Connection header received
0807 19:55:51.218204 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.218207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.218297 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.218425 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:51.218746 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.219502 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.220782 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.221183 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.221303 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.221775 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:51.222307 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:51.222433 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.222474 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.222546 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 19:55:51.231164 16220 raft_consensus.cc:1261] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 1 FOLLOWER]: Refusing update from remote peer 41c1aea78ab048b0bce1ebb92c0c9fa8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:51.231164 15794 raft_consensus.cc:1261] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Refusing update from remote peer 41c1aea78ab048b0bce1ebb92c0c9fa8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:51.232153 16354 consensus_queue.cc:1035] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:51.232558 16349 consensus_queue.cc:1035] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 19:55:51.237859 16294 tablet.cc:2369] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:51.248208 16360 mvcc.cc:205] Tried to move back new op lower bound from 7315998929833074688 to 7315998929637265408. Current Snapshot: MvccSnapshot[applied={T|T < 7315998929833074688}]
I20260807 19:55:51.251873 16359 mvcc.cc:205] Tried to move back new op lower bound from 7315998929833074688 to 7315998929637265408. Current Snapshot: MvccSnapshot[applied={T|T < 7315998929833074688}]
I20260807 19:55:51.268966 14427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:51.269327 14427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:51.277309 14427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1957c47155540b2b123544a1147f0b9: Sending DeleteTablet for 3 replicas of tablet 854b984b38e04d3e83481a914b724970
I20260807 19:55:51.278769 15764 tablet_service.cc:1514] Processing DeleteTablet for tablet 854b984b38e04d3e83481a914b724970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:51 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:50724
I20260807 19:55:51.279052 15977 tablet_service.cc:1514] Processing DeleteTablet for tablet 854b984b38e04d3e83481a914b724970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:51 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:44002
I20260807 19:55:51.279639 16190 tablet_service.cc:1514] Processing DeleteTablet for tablet 854b984b38e04d3e83481a914b724970 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:51 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:56154
I20260807 19:55:51.292500 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 14376
I20260807 19:55:51.293929 14473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:51.297451 16373 tablet_replica.cc:330] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: stopping tablet replica
I20260807 19:55:51.297927 16373 raft_consensus.cc:2229] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:51.298658 16373 raft_consensus.cc:2258] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:51.300953 16373 ts_tablet_manager.cc:1905] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:51.307971 16373 ts_tablet_manager.cc:1918] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:51.308174 16373 log.cc:1196] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/854b984b38e04d3e83481a914b724970
I20260807 19:55:51.309330 16373 ts_tablet_manager.cc:1939] T 854b984b38e04d3e83481a914b724970 P 41c1aea78ab048b0bce1ebb92c0c9fa8: Deleting consensus metadata
I20260807 19:55:51.318708 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.281903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45548 (local address 127.5.197.189:41493)
0807 19:55:51.282100 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.282107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.294228 (+ 12121us) server_negotiation.cc:407] Connection header received
0807 19:55:51.294329 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.294336 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.294433 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.294551 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.297040 (+ 2489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.298235 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.300135 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.300788 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.300928 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.304512 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.304520 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.304524 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.304568 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.308181 (+ 3613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.313188 (+ 5007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.313195 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.313200 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.313443 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.316348 (+ 2905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.316355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.316359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.316883 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.317212 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.318034 (+ 822us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.318339 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 19:55:51.321404 16376 tablet_replica.cc:330] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: stopping tablet replica
I20260807 19:55:51.321973 16376 raft_consensus.cc:2229] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:51.322600 16376 raft_consensus.cc:2258] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:51.325532 16372 tablet_replica.cc:330] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: stopping tablet replica
I20260807 19:55:51.326097 16372 raft_consensus.cc:2229] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:51.327339 16372 raft_consensus.cc:2258] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:51.327924 16376 ts_tablet_manager.cc:1905] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:51.341261 16376 ts_tablet_manager.cc:1918] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:51.341495 16376 log.cc:1196] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/854b984b38e04d3e83481a914b724970
I20260807 19:55:51.342113 16376 ts_tablet_manager.cc:1939] T 854b984b38e04d3e83481a914b724970 P adddd87259a44c0ea76e067c17e492d7: Deleting consensus metadata
I20260807 19:55:51.344810 16372 ts_tablet_manager.cc:1905] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:51.352547 16372 ts_tablet_manager.cc:1918] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:51.352732 16372 log.cc:1196] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/854b984b38e04d3e83481a914b724970
I20260807 19:55:51.353281 16372 ts_tablet_manager.cc:1939] T 854b984b38e04d3e83481a914b724970 P 480eb59f7269473b8b88b1565af9baaa: Deleting consensus metadata
I20260807 19:55:51.356668 16297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.291200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38968 (local address 127.5.197.188:41257)
0807 19:55:51.291471 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.291478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.320662 (+ 29184us) server_negotiation.cc:407] Connection header received
0807 19:55:51.320745 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.320751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.320842 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.320957 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.327000 (+ 6043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.328261 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.330392 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.331016 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.331122 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.348451 (+ 17329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.348459 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.348465 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.348520 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.352452 (+ 3932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.353808 (+ 1356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.353815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.353819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.354002 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.354594 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.354599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.354603 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.355007 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.355366 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.356021 (+ 655us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.356299 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260807 19:55:51.473984 14407 catalog_manager.cc:4841] TS adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887): tablet 854b984b38e04d3e83481a914b724970 (table test-table [id=3999515d71ec40ffbd38ff72f734099c]) successfully deleted
I20260807 19:55:51.474404 14407 catalog_manager.cc:4841] TS 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183): tablet 854b984b38e04d3e83481a914b724970 (table test-table [id=3999515d71ec40ffbd38ff72f734099c]) successfully deleted
I20260807 19:55:51.474690 14405 catalog_manager.cc:4841] TS 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761): tablet 854b984b38e04d3e83481a914b724970 (table test-table [id=3999515d71ec40ffbd38ff72f734099c]) successfully deleted
W20260807 19:55:51.474882 14405 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.197.130:38761, user_credentials={real_user=slave}} blocked reactor thread for 163281us
I20260807 19:55:51.475543 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 14376
I20260807 19:55:51.543098 16297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.519732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38982 (local address 127.5.197.188:41257)
0807 19:55:51.519932 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.519936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.521081 (+ 1145us) server_negotiation.cc:407] Connection header received
0807 19:55:51.521409 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.521416 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.521510 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.521589 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.524387 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.525624 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.527879 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.528637 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.528747 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.534408 (+ 5661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.534416 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.534421 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.534475 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.538282 (+ 3807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.539299 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.539306 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.539309 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.539501 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.540040 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.540046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.540050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.540539 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.540809 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.542421 (+ 1612us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.542695 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:55:51.560217 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:51.520701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45564 (local address 127.5.197.189:41493)
0807 19:55:51.520940 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:51.520946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:51.542184 (+ 21238us) server_negotiation.cc:407] Connection header received
0807 19:55:51.544012 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:51.544020 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:51.544122 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:51.544200 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:51.546653 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.547959 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.550580 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:51.551131 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:51.551213 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:51.554329 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:51.554338 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:51.554343 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:51.554392 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:51.557529 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.558198 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.558204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.558208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.558370 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:51.558737 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:51.558742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:51.558746 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:51.559069 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:51.559332 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:51.559642 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 19:55:51.559903 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:55:52.259313 16386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.258350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.130:52567)
0807 19:55:52.258857 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.259034 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":241,"threads_started":1}
W20260807 19:55:52.259698 16066 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:45893 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
I20260807 19:55:52.262034 16388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.261133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:42665)
0807 19:55:52.261628 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.261772 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":249,"threads_started":1}
W20260807 19:55:52.262432 16292 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:45893 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
I20260807 19:55:52.265498 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.264728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.129:38561)
0807 19:55:52.265141 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.265300 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":203,"threads_started":1}
W20260807 19:55:52.265862 15856 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:45893 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
I20260807 19:55:52.776473 16390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1957c47155540b2b123544a1147f0b9)
I20260807 19:55:52.776809 16390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } }
I20260807 19:55:52.777642 16391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1957c47155540b2b123544a1147f0b9)
I20260807 19:55:52.777899 16391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } }
I20260807 19:55:52.778398 16390 leader_election.cc:288] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1957c47155540b2b123544a1147f0b9 (127.5.197.190:45893), 741c64d32b914d9b8e74c5a610aa2834 (127.5.197.189:41493)
I20260807 19:55:52.779239 16391 leader_election.cc:288] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1957c47155540b2b123544a1147f0b9 (127.5.197.190:45893), 6ae7f7fe7c87449e93175f562542616d (127.5.197.188:41257)
I20260807 19:55:52.780457 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.779339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37636)
0807 19:55:52.779930 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.780175 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":245,"threads_started":1}
W20260807 19:55:52.780819 15282 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
I20260807 19:55:52.781327 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.778603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37634)
0807 19:55:52.780839 (+ 2236us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.781049 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2111,"thread_start_us":1968,"threads_started":1}
I20260807 19:55:52.783211 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.782765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37652)
0807 19:55:52.782965 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.783051 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260807 19:55:52.783442 15282 leader_election.cc:334] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b1957c47155540b2b123544a1147f0b9 (127.5.197.190:45893): Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
W20260807 19:55:52.783756 15567 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
I20260807 19:55:52.787289 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.786686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37666)
0807 19:55:52.786859 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.787044 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 19:55:52.787518 15567 leader_election.cc:334] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b1957c47155540b2b123544a1147f0b9 (127.5.197.190:45893): Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
I20260807 19:55:52.788242 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.779511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:41257 (local address 127.0.0.1:38986)
0807 19:55:52.780146 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.780167 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:52.780311 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:52.780914 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:52.780919 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:52.780950 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:52.781297 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.781322 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.783232 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.783239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.785485 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.785505 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.787372 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.787379 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.787558 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.787595 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:55:52.787744 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 19:55:52.787894 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":387,"threads_started":1}
I20260807 19:55:52.788301 16396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.780005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38986 (local address 127.5.197.188:41257)
0807 19:55:52.780508 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:52.780525 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:52.780553 (+ 28us) server_negotiation.cc:407] Connection header received
0807 19:55:52.780635 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:52.780640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:52.780720 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:52.781482 (+ 762us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:52.781767 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.783027 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.785670 (+ 2643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.787187 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.787320 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.787533 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:52.787837 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 19:55:52.787963 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":370,"thread_start_us":235,"threads_started":1}
I20260807 19:55:52.788993 15604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "741c64d32b914d9b8e74c5a610aa2834" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6ae7f7fe7c87449e93175f562542616d" is_pre_election: true
I20260807 19:55:52.789466 15604 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 741c64d32b914d9b8e74c5a610aa2834 in term 1.
I20260807 19:55:52.789956 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.780916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:41493 (local address 127.0.0.1:45566)
0807 19:55:52.781533 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.781562 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:52.781705 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:52.783718 (+ 2013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:52.783723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:52.783758 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:52.784092 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.784103 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.785276 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.785281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.787561 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.787603 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.789037 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.789043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.789259 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.789293 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:55:52.789383 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 19:55:52.789528 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"mutex_wait_us":1,"thread_start_us":2509,"threads_started":1}
I20260807 19:55:52.789988 15280 leader_election.cc:302] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ae7f7fe7c87449e93175f562542616d, 741c64d32b914d9b8e74c5a610aa2834; no voters: b1957c47155540b2b123544a1147f0b9
I20260807 19:55:52.790433 16391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 19:55:52.790616 16391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1957c47155540b2b123544a1147f0b9)
I20260807 19:55:52.790755 16391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:55:52.790911 16401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.781491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45566 (local address 127.5.197.189:41493)
0807 19:55:52.782717 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:52.782722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:52.782745 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:55:52.782802 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:52.782806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:52.782871 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:52.782967 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:52.784268 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.785145 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.787810 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.788830 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.788952 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.789056 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:52.790279 (+ 1223us) server_negotiation.cc:299] Negotiation successful
0807 19:55:52.790421 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1085,"thread_start_us":883,"threads_started":1}
I20260807 19:55:52.791406 15316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ae7f7fe7c87449e93175f562542616d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "741c64d32b914d9b8e74c5a610aa2834" is_pre_election: true
I20260807 19:55:52.793268 16391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } }
I20260807 19:55:52.793769 15316 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ae7f7fe7c87449e93175f562542616d in current term 2: Already voted for candidate 741c64d32b914d9b8e74c5a610aa2834 in this term.
I20260807 19:55:52.794327 16391 leader_election.cc:288] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [CANDIDATE]: Term 2 election: Requested vote from peers b1957c47155540b2b123544a1147f0b9 (127.5.197.190:45893), 6ae7f7fe7c87449e93175f562542616d (127.5.197.188:41257)
I20260807 19:55:52.794515 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.794029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37690)
0807 19:55:52.794206 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.794307 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 19:55:52.794863 15604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "741c64d32b914d9b8e74c5a610aa2834" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6ae7f7fe7c87449e93175f562542616d"
I20260807 19:55:52.795115 15604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:55:52.795451 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.795064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37706)
0807 19:55:52.795201 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.795296 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 19:55:52.795614 15282 leader_election.cc:334] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b1957c47155540b2b123544a1147f0b9 (127.5.197.190:45893): Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
I20260807 19:55:52.795924 15567 leader_election.cc:302] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ae7f7fe7c87449e93175f562542616d; no voters: 741c64d32b914d9b8e74c5a610aa2834, b1957c47155540b2b123544a1147f0b9
I20260807 19:55:52.797668 15604 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 741c64d32b914d9b8e74c5a610aa2834 in term 2.
I20260807 19:55:52.797888 16390 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 19:55:52.798157 15280 leader_election.cc:302] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ae7f7fe7c87449e93175f562542616d, 741c64d32b914d9b8e74c5a610aa2834; no voters: b1957c47155540b2b123544a1147f0b9
I20260807 19:55:52.798449 16391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:55:52.798898 16391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [term 2 LEADER]: Becoming Leader. State: Replica: 741c64d32b914d9b8e74c5a610aa2834, State: Running, Role: LEADER
I20260807 19:55:52.799305 16391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } }
I20260807 19:55:52.801266 16403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 741c64d32b914d9b8e74c5a610aa2834. Latest consensus state: current_term: 2 leader_uuid: "741c64d32b914d9b8e74c5a610aa2834" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:52.801625 16403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:52.802364 16407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:52.806152 16407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:52.807032 16407 catalog_manager.cc:1259] Loaded cluster ID: b742d50cc4bd435c950e305ee8ad1e27
I20260807 19:55:52.807116 16407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:52.808378 16407 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:52.809216 16407 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Loaded TSK: 0
I20260807 19:55:52.810076 16407 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:55:52.851163 15302 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:52.858628 15302 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:52.863205 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.862757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37720)
0807 19:55:52.862910 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.863016 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 19:55:52.863338 15604 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [term 2 FOLLOWER]: Refusing update from remote peer 741c64d32b914d9b8e74c5a610aa2834: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 19:55:52.864173 16403 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 19:55:52.864426 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.863975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37730)
0807 19:55:52.864171 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.864260 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 19:55:52.864636 15282 consensus_peers.cc:487] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 -> Peer b1957c47155540b2b123544a1147f0b9 (127.5.197.190:45893): Couldn't send request to peer b1957c47155540b2b123544a1147f0b9. Status: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 19:55:52.866814 16390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 741c64d32b914d9b8e74c5a610aa2834. Latest consensus state: current_term: 2 leader_uuid: "741c64d32b914d9b8e74c5a610aa2834" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:52.867075 16390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:55:52.868777 16391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "741c64d32b914d9b8e74c5a610aa2834" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:52.869148 16391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:52.869418 16411 mvcc.cc:205] Tried to move back new op lower bound from 7315998936520806400 to 7315998936269660160. Current Snapshot: MvccSnapshot[applied={T|T < 7315998936520806400}]
I20260807 19:55:52.870095 16390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "741c64d32b914d9b8e74c5a610aa2834" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b1957c47155540b2b123544a1147f0b9" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45893 } } peers { permanent_uuid: "741c64d32b914d9b8e74c5a610aa2834" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 41493 } attrs { promote: false } } peers { permanent_uuid: "6ae7f7fe7c87449e93175f562542616d" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 41257 } attrs { promote: false } } }
I20260807 19:55:52.870375 16390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae7f7fe7c87449e93175f562542616d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:55:52.886121 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.877743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:37887 (local address 127.0.0.1:56164)
0807 19:55:52.877922 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.877942 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:52.878054 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:52.878822 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:52.878827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:52.878853 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:52.879084 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.879097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.880935 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.880942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.883146 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.883167 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.885241 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.885248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.885452 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.885498 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 19:55:52.885578 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 19:55:52.885758 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 19:55:52.887358 16419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.877876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56164 (local address 127.5.197.131:37887)
0807 19:55:52.878451 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:52.878458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:52.878479 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:55:52.878561 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:52.878568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:52.878656 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:52.879239 (+ 583us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:52.879476 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.880737 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.883424 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.885006 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.886724 (+ 1718us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.886853 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:52.886907 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 19:55:52.887052 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":298,"threads_started":1}
I20260807 19:55:52.893592 16190 tablet_service.cc:1467] Processing CreateTablet for tablet 96e9767d668e47e3b04cb92f1680ff1f (DEFAULT_TABLE table=test-table [id=400f2d33b032420981a9c454a2b8e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:52.893788 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.879013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:35183 (local address 127.0.0.1:50740)
0807 19:55:52.886394 (+ 7381us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.886417 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:52.886537 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:52.886909 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:52.886914 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:52.886941 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:52.887134 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.887146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.888964 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.888970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.891061 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.891081 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.892837 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.892842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.893038 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.893075 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:55:52.893147 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 19:55:52.893310 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7279,"thread_start_us":13448,"threads_started":1}
I20260807 19:55:52.894124 16190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96e9767d668e47e3b04cb92f1680ff1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:52.895114 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.879490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50740 (local address 127.5.197.129:35183)
0807 19:55:52.885366 (+ 5876us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:52.885372 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:52.886483 (+ 1111us) server_negotiation.cc:407] Connection header received
0807 19:55:52.886658 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:52.886663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:52.886756 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:52.887299 (+ 543us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:52.887477 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.888739 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.891312 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.892626 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.894583 (+ 1957us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.894704 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:52.894757 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 19:55:52.894897 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5740,"thread_start_us":5598,"threads_started":1}
I20260807 19:55:52.895843 15764 tablet_service.cc:1467] Processing CreateTablet for tablet 96e9767d668e47e3b04cb92f1680ff1f (DEFAULT_TABLE table=test-table [id=400f2d33b032420981a9c454a2b8e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:52.896270 15764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96e9767d668e47e3b04cb92f1680ff1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:52.900352 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.878611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38761 (local address 127.0.0.1:44020)
0807 19:55:52.878764 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.878781 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:52.878897 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:52.893590 (+ 14693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:52.893595 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:52.893630 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:52.894219 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.894232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.895568 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.895575 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.897507 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:52.897524 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.899562 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.899568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:52.899775 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.899812 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:55:52.899909 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 19:55:52.900062 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 19:55:52.900527 16420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.879036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.5.197.130:38761)
0807 19:55:52.893214 (+ 14178us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:52.893221 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:52.893241 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:55:52.893324 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:52.893330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:52.893410 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:52.893752 (+ 342us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:52.894400 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.895394 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.898114 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:52.899304 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:52.899458 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:52.899591 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:52.899949 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 19:55:52.900107 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14041,"thread_start_us":13936,"threads_started":1}
I20260807 19:55:52.901646 15977 tablet_service.cc:1467] Processing CreateTablet for tablet 96e9767d668e47e3b04cb92f1680ff1f (DEFAULT_TABLE table=test-table [id=400f2d33b032420981a9c454a2b8e52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:52.902160 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96e9767d668e47e3b04cb92f1680ff1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:52.902842 16425 tablet_bootstrap.cc:492] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: Bootstrap starting.
I20260807 19:55:52.904199 16426 tablet_bootstrap.cc:492] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: Bootstrap starting.
I20260807 19:55:52.904734 16425 tablet_bootstrap.cc:654] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:52.906028 16426 tablet_bootstrap.cc:654] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:52.909126 16426 tablet_bootstrap.cc:492] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: No bootstrap required, opened a new log
I20260807 19:55:52.909288 16426 ts_tablet_manager.cc:1397] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 19:55:52.909839 16425 tablet_bootstrap.cc:492] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: No bootstrap required, opened a new log
I20260807 19:55:52.909981 16425 ts_tablet_manager.cc:1397] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260807 19:55:52.909972 16426 raft_consensus.cc:348] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:52.910215 16426 raft_consensus.cc:374] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:52.910308 16426 raft_consensus.cc:729] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 480eb59f7269473b8b88b1565af9baaa, State: Initialized, Role: FOLLOWER
I20260807 19:55:52.910547 16426 consensus_queue.cc:260] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:52.910743 16425 raft_consensus.cc:348] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:52.911000 16425 raft_consensus.cc:374] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:52.911105 16425 raft_consensus.cc:729] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adddd87259a44c0ea76e067c17e492d7, State: Initialized, Role: FOLLOWER
I20260807 19:55:52.911432 16425 consensus_queue.cc:260] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:52.912226 16426 ts_tablet_manager.cc:1428] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 19:55:52.912617 16432 tablet_bootstrap.cc:492] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: Bootstrap starting.
I20260807 19:55:52.914561 16432 tablet_bootstrap.cc:654] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:52.916373 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.911954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.129:51107)
0807 19:55:52.915915 (+ 3961us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.916119 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3800,"thread_start_us":3626,"threads_started":1}
I20260807 19:55:52.917078 16425 ts_tablet_manager.cc:1428] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260807 19:55:52.918953 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.917778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:56221)
0807 19:55:52.918526 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.918685 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":602,"threads_started":1}
I20260807 19:55:52.919603 15857 heartbeater.cc:503] Master 127.5.197.189:41493 was elected leader, sending a full tablet report...
I20260807 19:55:52.920179 16432 tablet_bootstrap.cc:492] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: No bootstrap required, opened a new log
I20260807 19:55:52.920360 16432 ts_tablet_manager.cc:1397] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 19:55:52.921254 16432 raft_consensus.cc:348] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:52.921491 16432 raft_consensus.cc:374] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:52.921586 16432 raft_consensus.cc:729] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c1aea78ab048b0bce1ebb92c0c9fa8, State: Initialized, Role: FOLLOWER
I20260807 19:55:52.921804 16432 consensus_queue.cc:260] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:52.922538 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.918865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.129:34113)
0807 19:55:52.922248 (+ 3383us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.922330 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3244}
I20260807 19:55:52.923077 16432 ts_tablet_manager.cc:1428] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:52.923460 16293 heartbeater.cc:503] Master 127.5.197.189:41493 was elected leader, sending a full tablet report...
I20260807 19:55:52.924556 16442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.922836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.130:46775)
0807 19:55:52.924110 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.924300 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1121,"thread_start_us":1292,"threads_started":1}
I20260807 19:55:52.925458 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.924185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:34849)
0807 19:55:52.925216 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.925312 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":902}
I20260807 19:55:52.925808 16067 heartbeater.cc:503] Master 127.5.197.189:41493 was elected leader, sending a full tablet report...
I20260807 19:55:52.926191 16442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:52.925246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.130:48647)
0807 19:55:52.925937 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:52.926021 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":567}
I20260807 19:55:53.009281 16434 raft_consensus.cc:482] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:53.009545 16434 raft_consensus.cc:504] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:53.011165 16434 leader_election.cc:288] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761), 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:53.017633 16420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.011538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:54179 (local address 127.5.197.130:38761)
0807 19:55:53.011775 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:53.011781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:53.011875 (+ 94us) server_negotiation.cc:407] Connection header received
0807 19:55:53.012293 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:53.012299 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:53.012385 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:53.012474 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:53.013039 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.013849 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.015759 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.016627 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.016783 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.016850 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:53.017219 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 19:55:53.017368 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:55:53.017681 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.011912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:38955 (local address 127.5.197.129:35183)
0807 19:55:53.012136 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:53.012141 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:53.012330 (+ 189us) server_negotiation.cc:407] Connection header received
0807 19:55:53.012502 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:53.012507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:53.012579 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:53.012676 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:53.013310 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.014057 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.015940 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.016747 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.016914 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.016989 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:53.017308 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 19:55:53.017452 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:55:53.017668 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.011443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:38761 (local address 127.5.197.131:54179)
0807 19:55:53.011741 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.011764 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:53.012058 (+ 294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:53.012513 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:53.012517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:53.012546 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:53.012852 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:53.012865 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.014000 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.014005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:53.015563 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:53.015577 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.016850 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.016856 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:53.017058 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.017083 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:55:53.017157 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 19:55:53.017283 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260807 19:55:53.017742 16447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.011513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:35183 (local address 127.5.197.131:38955)
0807 19:55:53.012212 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.012236 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:53.012377 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:53.012737 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:53.012741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:53.012766 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:53.013077 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:53.013089 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.014225 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.014229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:53.015782 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:53.015798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.016957 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.016962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:53.017124 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.017164 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 19:55:53.017257 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 19:55:53.017381 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":397,"threads_started":1}
I20260807 19:55:53.018502 15794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96e9767d668e47e3b04cb92f1680ff1f" candidate_uuid: "adddd87259a44c0ea76e067c17e492d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "480eb59f7269473b8b88b1565af9baaa" is_pre_election: true
I20260807 19:55:53.018581 16009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96e9767d668e47e3b04cb92f1680ff1f" candidate_uuid: "adddd87259a44c0ea76e067c17e492d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" is_pre_election: true
I20260807 19:55:53.018765 15794 raft_consensus.cc:2454] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adddd87259a44c0ea76e067c17e492d7 in term 0.
I20260807 19:55:53.018985 16009 raft_consensus.cc:2454] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adddd87259a44c0ea76e067c17e492d7 in term 0.
I20260807 19:55:53.019327 16115 leader_election.cc:302] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 480eb59f7269473b8b88b1565af9baaa, adddd87259a44c0ea76e067c17e492d7; no voters:
I20260807 19:55:53.019804 16434 raft_consensus.cc:2781] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:53.020020 16434 raft_consensus.cc:482] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:53.020153 16434 raft_consensus.cc:3037] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:53.022435 16434 raft_consensus.cc:504] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:53.023039 16434 leader_election.cc:288] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [CANDIDATE]: Term 1 election: Requested vote from peers 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761), 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183)
I20260807 19:55:53.023576 16009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96e9767d668e47e3b04cb92f1680ff1f" candidate_uuid: "adddd87259a44c0ea76e067c17e492d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8"
I20260807 19:55:53.023692 15794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96e9767d668e47e3b04cb92f1680ff1f" candidate_uuid: "adddd87259a44c0ea76e067c17e492d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "480eb59f7269473b8b88b1565af9baaa"
I20260807 19:55:53.023838 16009 raft_consensus.cc:3037] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:53.023921 15794 raft_consensus.cc:3037] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:53.026964 15794 raft_consensus.cc:2454] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adddd87259a44c0ea76e067c17e492d7 in term 1.
I20260807 19:55:53.026964 16009 raft_consensus.cc:2454] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adddd87259a44c0ea76e067c17e492d7 in term 1.
I20260807 19:55:53.027448 16113 leader_election.cc:302] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c1aea78ab048b0bce1ebb92c0c9fa8, adddd87259a44c0ea76e067c17e492d7; no voters:
I20260807 19:55:53.027772 16434 raft_consensus.cc:2781] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:53.028199 16434 raft_consensus.cc:686] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 1 LEADER]: Becoming Leader. State: Replica: adddd87259a44c0ea76e067c17e492d7, State: Running, Role: LEADER
I20260807 19:55:53.028770 16434 consensus_queue.cc:237] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } }
I20260807 19:55:53.029278 16447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.028760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:46167)
0807 19:55:53.028981 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.029112 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 19:55:53.032716 15302 catalog_manager.cc:5495] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to adddd87259a44c0ea76e067c17e492d7 (127.5.197.131). New cstate: current_term: 1 leader_uuid: "adddd87259a44c0ea76e067c17e492d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adddd87259a44c0ea76e067c17e492d7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:53.062501 16419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.057372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56170 (local address 127.5.197.131:37887)
0807 19:55:53.057584 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:53.057589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:53.057608 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:55:53.057828 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:53.057832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:53.057915 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:53.058043 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:53.058387 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.059126 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.060450 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.060884 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.060980 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.061364 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:53.061939 (+ 575us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:53.062054 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:53.062153 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 19:55:53.062235 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:55:53.066898 15794 raft_consensus.cc:1261] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Refusing update from remote peer adddd87259a44c0ea76e067c17e492d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:53.067261 16009 raft_consensus.cc:1261] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 FOLLOWER]: Refusing update from remote peer adddd87259a44c0ea76e067c17e492d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:53.067682 16449 consensus_queue.cc:1035] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "480eb59f7269473b8b88b1565af9baaa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:53.068120 16434 consensus_queue.cc:1035] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c1aea78ab048b0bce1ebb92c0c9fa8" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 38761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:53.071115 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.070531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.129:42949)
0807 19:55:53.070785 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.070911 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260807 19:55:53.071138 16442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.070606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.130:50281)
0807 19:55:53.070865 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.070979 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260807 19:55:53.077280 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.076474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.129:34873)
0807 19:55:53.076960 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.077068 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359}
I20260807 19:55:53.084435 16457 mvcc.cc:205] Tried to move back new op lower bound from 7315998937355051008 to 7315998937210224640. Current Snapshot: MvccSnapshot[applied={T|T < 7315998937355051008}]
I20260807 19:55:53.085152 16442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.084720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.130:47727)
0807 19:55:53.084880 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.084988 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 19:55:53.086475 16447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.085903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:33825)
0807 19:55:53.086110 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.086248 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 19:55:53.088778 16447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.088275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.5.197.131:59683)
0807 19:55:53.088466 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.088576 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 19:55:53.104452 15301 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:53.104760 15301 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:53.110985 15301 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 741c64d32b914d9b8e74c5a610aa2834: Sending DeleteTablet for 3 replicas of tablet 96e9767d668e47e3b04cb92f1680ff1f
I20260807 19:55:53.112449 15764 tablet_service.cc:1514] Processing DeleteTablet for tablet 96e9767d668e47e3b04cb92f1680ff1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:53 UTC) from {username='oryx', principal='oryx/127.5.197.189@KRBTEST.COM'} at 127.0.0.1:50740
I20260807 19:55:53.112785 16190 tablet_service.cc:1514] Processing DeleteTablet for tablet 96e9767d668e47e3b04cb92f1680ff1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:53 UTC) from {username='oryx', principal='oryx/127.5.197.189@KRBTEST.COM'} at 127.0.0.1:56164
I20260807 19:55:53.113551 15977 tablet_service.cc:1514] Processing DeleteTablet for tablet 96e9767d668e47e3b04cb92f1680ff1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:53 UTC) from {username='oryx', principal='oryx/127.5.197.189@KRBTEST.COM'} at 127.0.0.1:44020
I20260807 19:55:53.113883 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 15552
I20260807 19:55:53.125092 16467 tablet_replica.cc:330] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: stopping tablet replica
I20260807 19:55:53.125366 16467 raft_consensus.cc:2229] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:53.125747 16467 raft_consensus.cc:2258] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:53.128798 16467 ts_tablet_manager.cc:1905] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:53.135463 16469 tablet_replica.cc:330] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: stopping tablet replica
I20260807 19:55:53.135736 16469 raft_consensus.cc:2229] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:53.136143 16469 raft_consensus.cc:2258] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:53.136862 16468 tablet_replica.cc:330] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: stopping tablet replica
I20260807 19:55:53.137074 16468 raft_consensus.cc:2229] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:53.137938 16468 raft_consensus.cc:2258] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:53.138962 16467 ts_tablet_manager.cc:1918] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:53.139240 16467 log.cc:1196] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/96e9767d668e47e3b04cb92f1680ff1f
I20260807 19:55:53.139870 16469 ts_tablet_manager.cc:1905] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:53.139962 16467 ts_tablet_manager.cc:1939] T 96e9767d668e47e3b04cb92f1680ff1f P 480eb59f7269473b8b88b1565af9baaa: Deleting consensus metadata
I20260807 19:55:53.141252 16468 ts_tablet_manager.cc:1905] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:53.141425 15282 catalog_manager.cc:4841] TS 480eb59f7269473b8b88b1565af9baaa (127.5.197.129:35183): tablet 96e9767d668e47e3b04cb92f1680ff1f (table test-table [id=400f2d33b032420981a9c454a2b8e52a]) successfully deleted
I20260807 19:55:53.145828 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.115629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50748 (local address 127.5.197.129:35183)
0807 19:55:53.115855 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:53.115862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:53.125676 (+ 9814us) server_negotiation.cc:407] Connection header received
0807 19:55:53.126259 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:53.126265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:53.126355 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:53.126419 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:53.128114 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.129195 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.131014 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.131791 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.131907 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.136112 (+ 4205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:53.136139 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:53.136161 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:53.136211 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:53.140936 (+ 4725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:53.142804 (+ 1868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:53.142815 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:53.142820 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:53.142999 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:53.143537 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:53.143542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:53.143545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:53.144118 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:53.144505 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:53.145147 (+ 642us) server_negotiation.cc:299] Negotiation successful
0807 19:55:53.145439 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 19:55:53.146766 16469 ts_tablet_manager.cc:1918] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:53.146894 16469 log.cc:1196] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/96e9767d668e47e3b04cb92f1680ff1f
I20260807 19:55:53.147338 15848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:53.147379 16469 ts_tablet_manager.cc:1939] T 96e9767d668e47e3b04cb92f1680ff1f P 41c1aea78ab048b0bce1ebb92c0c9fa8: Deleting consensus metadata
I20260807 19:55:53.148692 15279 catalog_manager.cc:4841] TS 41c1aea78ab048b0bce1ebb92c0c9fa8 (127.5.197.130:38761): tablet 96e9767d668e47e3b04cb92f1680ff1f (table test-table [id=400f2d33b032420981a9c454a2b8e52a]) successfully deleted
I20260807 19:55:53.150190 16468 ts_tablet_manager.cc:1918] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:53.150487 16468 log.cc:1196] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/96e9767d668e47e3b04cb92f1680ff1f
I20260807 19:55:53.151204 16468 ts_tablet_manager.cc:1939] T 96e9767d668e47e3b04cb92f1680ff1f P adddd87259a44c0ea76e067c17e492d7: Deleting consensus metadata
I20260807 19:55:53.152911 15282 catalog_manager.cc:4841] TS adddd87259a44c0ea76e067c17e492d7 (127.5.197.131:37887): tablet 96e9767d668e47e3b04cb92f1680ff1f (table test-table [id=400f2d33b032420981a9c454a2b8e52a]) successfully deleted
I20260807 19:55:53.242575 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.242018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37732)
0807 19:55:53.242244 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.242368 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 19:55:53.244199 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.243647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37734)
0807 19:55:53.243916 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.244016 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260807 19:55:53.244418 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 15552
I20260807 19:55:53.271560 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 15872
I20260807 19:55:53.287433 16420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.272360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44026 (local address 127.5.197.130:38761)
0807 19:55:53.272548 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:53.272552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:53.272656 (+ 104us) server_negotiation.cc:407] Connection header received
0807 19:55:53.272858 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:53.272862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:53.272930 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:53.273031 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:53.274749 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.275481 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.277324 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.277748 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.277847 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.281179 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:53.281200 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:53.281219 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:53.281258 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:53.284423 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:53.285277 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:53.285284 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:53.285287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:53.285418 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:53.285813 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:53.285815 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:53.285817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:53.286192 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:53.286469 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:53.286835 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 19:55:53.287050 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:55:53.288251 16060 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:53.415601 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 15872
I20260807 19:55:53.447358 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 16089
I20260807 19:55:53.462834 16419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.448347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56180 (local address 127.5.197.131:37887)
0807 19:55:53.448574 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:53.448580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:53.448601 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:55:53.448743 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:53.448749 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:53.448851 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:53.448950 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:53.450440 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.451283 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.452546 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:53.453243 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:53.453380 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:53.456442 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:53.456460 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:53.456478 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:53.456516 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:53.459794 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:53.460521 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:53.460532 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:53.460536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:53.460713 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:53.461169 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:53.461175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:53.461177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:53.461586 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:53.461908 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:53.462243 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 19:55:53.462471 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:55:53.463634 16281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:53.599458 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 16089
I20260807 19:55:53.626250 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 15095
I20260807 19:55:53.627529 15346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:53.754134 16477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:53.752367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45893 (local address 127.0.0.1:37750)
0807 19:55:53.753827 (+ 1460us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:53.753942 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1332,"thread_start_us":1248,"threads_started":1}
I20260807 19:55:53.754164 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 15095
I20260807 19:55:53.782056 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 15250
I20260807 19:55:53.783069 15629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:55:53.902001 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 15250
2026-08-07T19:55:53Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9938 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:55:54 dist-test-slave-6bbx krb5kdc[16485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:55:54 dist-test-slave-6bbx krb5kdc[16485](info): set up 2 sockets
Aug 07 19:55:54 dist-test-slave-6bbx krb5kdc[16485](info): commencing operation
krb5kdc: starting...
W20260807 19:55:55.122323 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.008s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:55:55 dist-test-slave-6bbx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:55:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:55:55Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab.
Entry for principal oryx/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab.
I20260807 19:55:55.411938 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37179
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab
--principal=oryx/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:55.755460 16501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:55.755806 16501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:55.755947 16501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:55.763365 16501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:55:55.763492 16501 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 19:55:55.763564 16501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:55.763650 16501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:55.763742 16501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:55:55.763828 16501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:55:55.773876 16501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37179
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.190.keytab
--principal=oryx/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:55.775241 16501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:55.776641 16501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:55.788422 16509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:55.788470 16510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:55.788386 16513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:55.789618 16501 server_base.cc:1034] running on GCE node
I20260807 19:55:55.790378 16501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:55.791842 16501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:55.793059 16501 hybrid_clock.cc:648] HybridClock initialized: now 1786132555792999 us; error 30 us; skew 500 ppm
I20260807 19:55:55.793365 16501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:55 dist-test-slave-6bbx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132555, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:55.796540 16501 init.cc:377] Logged in from keytab as oryx/127.5.197.190@KRBTEST.COM (short username oryx)
I20260807 19:55:55.798116 16501 webserver.cc:460] Webserver started at http://127.5.197.190:45427/ using document root <none> and password file <none>
I20260807 19:55:55.798862 16501 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:55.798962 16501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:55.799304 16501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:55.802461 16501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "ea61888f2cca4e9b850618618d98a7f5"
format_stamp: "Formatted at 2026-08-07 19:55:55 on dist-test-slave-6bbx"
server_key: "4411a3cc35b828b5d8fefb0a8c326b09"
server_key_iv: "77a64c54311ceb6ff950379f07180960"
server_key_version: "encryptionkey@0"
I20260807 19:55:55.803315 16501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "ea61888f2cca4e9b850618618d98a7f5"
format_stamp: "Formatted at 2026-08-07 19:55:55 on dist-test-slave-6bbx"
server_key: "4411a3cc35b828b5d8fefb0a8c326b09"
server_key_iv: "77a64c54311ceb6ff950379f07180960"
server_key_version: "encryptionkey@0"
I20260807 19:55:55.808933 16501 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 19:55:55.812644 16524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:55.814055 16501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:55:55.814230 16501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "ea61888f2cca4e9b850618618d98a7f5"
format_stamp: "Formatted at 2026-08-07 19:55:55 on dist-test-slave-6bbx"
server_key: "4411a3cc35b828b5d8fefb0a8c326b09"
server_key_iv: "77a64c54311ceb6ff950379f07180960"
server_key_version: "encryptionkey@0"
I20260807 19:55:55.814460 16501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:55.829820 16501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:55.834074 16501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:55.834344 16501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:55.855587 16501 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37179
I20260807 19:55:55.855567 16616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37179 every 8 connection(s)
I20260807 19:55:55.857125 16501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:55:55.860634 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 16501
I20260807 19:55:55.860913 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:55:55.861588 16617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:55.861804 5910 external_mini_cluster.cc:1428] Setting key 6e3b89e61f92029ff2d4d120a6184123
I20260807 19:55:55.876946 16617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Bootstrap starting.
Aug 07 19:55:55 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:55.880746 16617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:55.882006 16617 log.cc:824] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:55.885677 16617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: No bootstrap required, opened a new log
I20260807 19:55:55.886492 16622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:55.864052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.5.197.190:37179)
0807 19:55:55.864882 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:55.864897 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:55.864947 (+ 50us) server_negotiation.cc:407] Connection header received
0807 19:55:55.866748 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:55.866773 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:55.867201 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:55.867611 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:55.869477 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:55.870841 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:55.872617 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:55.873382 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:55.873533 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:55.878463 (+ 4930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:55.878472 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:55.878489 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:55.878543 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:55.881692 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:55.882764 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:55.882774 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:55.882785 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:55.883031 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:55.883447 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:55.883452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:55.883455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:55.884103 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:55.884364 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:55.884876 (+ 512us) server_negotiation.cc:299] Negotiation successful
0807 19:55:55.885256 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":386,"threads_started":1}
I20260807 19:55:55.893551 16617 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61888f2cca4e9b850618618d98a7f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37179 } }
I20260807 19:55:55.893944 16617 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:55.894055 16617 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea61888f2cca4e9b850618618d98a7f5, State: Initialized, Role: FOLLOWER
I20260807 19:55:55.894630 16617 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61888f2cca4e9b850618618d98a7f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37179 } }
I20260807 19:55:55.894865 16617 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:55:55.894999 16617 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:55:55.895159 16617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:55.897447 16617 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61888f2cca4e9b850618618d98a7f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37179 } }
I20260807 19:55:55.897993 16617 leader_election.cc:302] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea61888f2cca4e9b850618618d98a7f5; no voters:
I20260807 19:55:55.898571 16617 leader_election.cc:288] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:55:55.898700 16625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:55.899780 16625 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [term 1 LEADER]: Becoming Leader. State: Replica: ea61888f2cca4e9b850618618d98a7f5, State: Running, Role: LEADER
I20260807 19:55:55.900426 16625 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61888f2cca4e9b850618618d98a7f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37179 } }
I20260807 19:55:55.900962 16617 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:55:55.903693 16627 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea61888f2cca4e9b850618618d98a7f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61888f2cca4e9b850618618d98a7f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37179 } } }
I20260807 19:55:55.904237 16628 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea61888f2cca4e9b850618618d98a7f5. Latest consensus state: current_term: 1 leader_uuid: "ea61888f2cca4e9b850618618d98a7f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea61888f2cca4e9b850618618d98a7f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37179 } } }
I20260807 19:55:55.904546 16627 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:55.904609 16628 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:55:55.906956 16637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:55:55.911546 16637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:55:55.920357 16637 catalog_manager.cc:1347] Generated new cluster ID: abec8fc00c8747c2801598d1ae4bbfce
I20260807 19:55:55.920490 16637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:55:55.937284 16637 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:55:55.938704 16637 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:55:55.949298 16637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Generated new TSK 0
I20260807 19:55:55.950156 16637 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab.
Entry for principal oryx/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab.
I20260807 19:55:56.019003 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37179
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab
--principal=oryx/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:56.370100 16655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:56.370451 16655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:56.370601 16655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:56.378118 16655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:56.378259 16655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:56.378392 16655 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:56.378508 16655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:55:56.389353 16655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab
--principal=oryx/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:37179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:56.390779 16655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:56.392289 16655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:56.405992 16661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:56.405984 16662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:56.406296 16667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:56.407068 16655 server_base.cc:1034] running on GCE node
I20260807 19:55:56.407845 16655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:56.408929 16655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:56.410180 16655 hybrid_clock.cc:648] HybridClock initialized: now 1786132556410090 us; error 59 us; skew 500 ppm
I20260807 19:55:56.410496 16655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:56 dist-test-slave-6bbx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132556, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:56.413898 16655 init.cc:377] Logged in from keytab as oryx/127.5.197.129@KRBTEST.COM (short username oryx)
I20260807 19:55:56.415475 16655 webserver.cc:460] Webserver started at http://127.5.197.129:46727/ using document root <none> and password file <none>
I20260807 19:55:56.416256 16655 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:56.416365 16655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:56.416704 16655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:56.419910 16655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "4c0b1f9e2bfb40e2b57810535f529d91"
format_stamp: "Formatted at 2026-08-07 19:55:56 on dist-test-slave-6bbx"
server_key: "a0ce2d100921a8d556dd12a865cb97ff"
server_key_iv: "ea5085555384dbd570f2471ac224f857"
server_key_version: "encryptionkey@0"
I20260807 19:55:56.420766 16655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "4c0b1f9e2bfb40e2b57810535f529d91"
format_stamp: "Formatted at 2026-08-07 19:55:56 on dist-test-slave-6bbx"
server_key: "a0ce2d100921a8d556dd12a865cb97ff"
server_key_iv: "ea5085555384dbd570f2471ac224f857"
server_key_version: "encryptionkey@0"
I20260807 19:55:56.426337 16655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 19:55:56.430047 16677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:56.431459 16655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:55:56.431643 16655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "4c0b1f9e2bfb40e2b57810535f529d91"
format_stamp: "Formatted at 2026-08-07 19:55:56 on dist-test-slave-6bbx"
server_key: "a0ce2d100921a8d556dd12a865cb97ff"
server_key_iv: "ea5085555384dbd570f2471ac224f857"
server_key_version: "encryptionkey@0"
I20260807 19:55:56.431926 16655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:56.446144 16655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:56.450721 16655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:56.450991 16655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:56.453838 16655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:56.453929 16655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:56.454059 16655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:56.454124 16655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:56 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132556, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:56.479377 16693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:56.455211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37179 (local address 127.5.197.129:43997)
0807 19:55:56.456158 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:56.456206 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:56.458591 (+ 2385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:56.459600 (+ 1009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:56.459613 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:56.460480 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:56.461422 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:56.461459 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.463039 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.463046 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:56.465110 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:56.465133 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.466177 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.466186 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:56.466425 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:56.467147 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:56.467172 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:56.470226 (+ 3054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:56.474129 (+ 3903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:56.474140 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:56.474157 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:56.474676 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:56.475097 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:56.475102 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:56.475106 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:56.475336 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:56.475952 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:56.475961 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:56.476543 (+ 582us) client_negotiation.cc:769] Sending connection context
0807 19:55:56.476992 (+ 449us) client_negotiation.cc:240] Negotiation successful
0807 19:55:56.477635 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":413,"threads_started":1}
I20260807 19:55:56.480876 16692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:56.454522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:43997 (local address 127.5.197.190:37179)
0807 19:55:56.455072 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:56.455079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:56.456372 (+ 1293us) server_negotiation.cc:407] Connection header received
0807 19:55:56.459016 (+ 2644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:56.459023 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:56.459123 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:56.459267 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:56.461663 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.462846 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.465346 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.465911 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.466040 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:56.470561 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:56.470569 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:56.470575 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:56.470632 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:56.473949 (+ 3317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:56.474828 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:56.474833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:56.474835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:56.474977 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:56.475460 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:56.475464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:56.475466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:56.475802 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:56.475945 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:56.480252 (+ 4307us) server_negotiation.cc:299] Negotiation successful
0807 19:55:56.480501 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":298,"threads_started":1}
I20260807 19:55:56.502660 16692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:56.487277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58873 (local address 127.5.197.190:37179)
0807 19:55:56.487496 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:56.487503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:56.488321 (+ 818us) server_negotiation.cc:407] Connection header received
0807 19:55:56.488430 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:56.488433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:56.488505 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:56.488594 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:56.489946 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.490726 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.493000 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.493507 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.493645 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:56.496178 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:56.496185 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:56.496189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:56.496234 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:56.499191 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:56.500148 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:56.500152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:56.500154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:56.500338 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:56.500892 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:56.500899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:56.500903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:56.501330 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:56.501480 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:56.501986 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 19:55:56.502269 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:55:56.502733 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:56.487260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37179 (local address 127.5.197.129:58873)
0807 19:55:56.488076 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:56.488101 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:56.488303 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:56.488643 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:56.488649 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:56.489334 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:56.489755 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:56.489771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.490910 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.490920 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:56.492839 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:56.492859 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:56.493768 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:56.493776 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:56.493984 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:56.494666 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:56.494692 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:56.495901 (+ 1209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:56.499338 (+ 3437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:56.499344 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:56.499349 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:56.500010 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:56.500497 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:56.500502 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:56.500506 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:56.500709 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:56.501490 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:56.501495 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:56.501674 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 19:55:56.501796 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 19:55:56.502294 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":451,"threads_started":1}
I20260807 19:55:56.504760 16849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:42285 every 8 connection(s)
I20260807 19:55:56.504791 16655 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:42285
I20260807 19:55:56.506521 16655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:55:56.507853 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 16655
I20260807 19:55:56.508080 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:55:56.508734 16850 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37179
I20260807 19:55:56.508790 5910 external_mini_cluster.cc:1428] Setting key 8ae4073a230b82ff7cf738824fe1bdd5
I20260807 19:55:56.508942 16850 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:56.509616 16850 heartbeater.cc:511] Master 127.5.197.190:37179 requested a full tablet report, sending...
I20260807 19:55:56.511744 16552 ts_manager.cc:194] Registered new tserver with Master: 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285)
I20260807 19:55:56.513278 16552 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:43997
WARNING: no policy specified for oryx/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab.
Entry for principal oryx/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab.
I20260807 19:55:56.571143 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37179
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab
--principal=oryx/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:56.924806 16855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:56.925119 16855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:56.925253 16855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:56.932608 16855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:56.932736 16855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:56.932852 16855 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:56.932960 16855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:55:56.943068 16855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab
--principal=oryx/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:37179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:56.944525 16855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:56.946003 16855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:55:56.959530 16864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:56.959503 16863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:56.959589 16868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:56.960529 16855 server_base.cc:1034] running on GCE node
I20260807 19:55:56.961202 16855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:56.962218 16855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:56.963431 16855 hybrid_clock.cc:648] HybridClock initialized: now 1786132556963346 us; error 55 us; skew 500 ppm
I20260807 19:55:56.963763 16855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:56 dist-test-slave-6bbx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132556, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:56.967010 16855 init.cc:377] Logged in from keytab as oryx/127.5.197.130@KRBTEST.COM (short username oryx)
I20260807 19:55:56.968575 16855 webserver.cc:460] Webserver started at http://127.5.197.130:44877/ using document root <none> and password file <none>
I20260807 19:55:56.969309 16855 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:56.969417 16855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:56.969738 16855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:56.972851 16855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "eb7afe675c0c43c7aa09a0ff39f35588"
format_stamp: "Formatted at 2026-08-07 19:55:56 on dist-test-slave-6bbx"
server_key: "a4911bdb2cb888c875b0856b54ad5680"
server_key_iv: "314dd1f78f0615193b4c2ceae173fbb9"
server_key_version: "encryptionkey@0"
I20260807 19:55:56.973663 16855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "eb7afe675c0c43c7aa09a0ff39f35588"
format_stamp: "Formatted at 2026-08-07 19:55:56 on dist-test-slave-6bbx"
server_key: "a4911bdb2cb888c875b0856b54ad5680"
server_key_iv: "314dd1f78f0615193b4c2ceae173fbb9"
server_key_version: "encryptionkey@0"
I20260807 19:55:56.979089 16855 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:55:56.982818 16886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:56.984331 16855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:55:56.984496 16855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "eb7afe675c0c43c7aa09a0ff39f35588"
format_stamp: "Formatted at 2026-08-07 19:55:56 on dist-test-slave-6bbx"
server_key: "a4911bdb2cb888c875b0856b54ad5680"
server_key_iv: "314dd1f78f0615193b4c2ceae173fbb9"
server_key_version: "encryptionkey@0"
I20260807 19:55:56.984714 16855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:57.005774 16855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:57.010325 16855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:57.010597 16855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:57.013504 16855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:57.013598 16855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:57.013739 16855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:57.013833 16855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:57 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132556, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:57.038324 16901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.014005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:47267 (local address 127.5.197.190:37179)
0807 19:55:57.014780 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:57.014786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:57.015842 (+ 1056us) server_negotiation.cc:407] Connection header received
0807 19:55:57.018207 (+ 2365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:57.018212 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:57.018310 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:57.018426 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:57.021182 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.022197 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.025053 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.025529 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.025652 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.030643 (+ 4991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:57.030650 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:57.030656 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:57.030711 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:57.034212 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.035381 (+ 1169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.035386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.035388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.035545 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.036253 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.036259 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.036262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.036673 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:57.036838 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:57.037644 (+ 806us) server_negotiation.cc:299] Negotiation successful
0807 19:55:57.037897 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":516,"threads_started":1}
I20260807 19:55:57.039429 16902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.014668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37179 (local address 127.5.197.130:47267)
0807 19:55:57.015621 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:57.015702 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:57.017887 (+ 2185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:57.018776 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:57.018813 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:57.019841 (+ 1028us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:57.020939 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.020973 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.022404 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.022411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.024865 (+ 2454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.024883 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.025816 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.025825 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.026047 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.026830 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:57.026867 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:57.030288 (+ 3421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:57.034382 (+ 4094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.034393 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.034413 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.035199 (+ 786us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.035730 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.035735 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.035739 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.036115 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.036825 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:57.036833 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:57.037256 (+ 423us) client_negotiation.cc:769] Sending connection context
0807 19:55:57.037509 (+ 253us) client_negotiation.cc:240] Negotiation successful
0807 19:55:57.038115 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":369,"threads_started":1}
I20260807 19:55:57.059983 16901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.045954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:52785 (local address 127.5.197.190:37179)
0807 19:55:57.046124 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:57.046129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:57.046618 (+ 489us) server_negotiation.cc:407] Connection header received
0807 19:55:57.046786 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:57.046792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:57.046866 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:57.046951 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:57.047981 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.048978 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.050865 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.051384 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.051510 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.053895 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:57.053901 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:57.053906 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:57.053940 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:57.056847 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.057687 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.057694 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.057698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.057878 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.058353 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.058359 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.058363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.058824 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:57.058963 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:57.059377 (+ 414us) server_negotiation.cc:299] Negotiation successful
0807 19:55:57.059597 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 19:55:57.060153 16989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.045932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37179 (local address 127.5.197.130:52785)
0807 19:55:57.046510 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:57.046526 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:57.046669 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:57.046992 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:57.046996 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:57.047477 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:57.047837 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.047849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.049124 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.049133 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.050707 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.050724 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.051595 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.051602 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.051788 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.052519 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:57.052538 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:57.053705 (+ 1167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:57.056971 (+ 3266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.056977 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.056981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.057554 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.058042 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.058050 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.058057 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.058230 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.058945 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:57.058950 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:57.059135 (+ 185us) client_negotiation.cc:769] Sending connection context
0807 19:55:57.059256 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 19:55:57.059615 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":306,"threads_started":1}
I20260807 19:55:57.067880 16855 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:45751
I20260807 19:55:57.067900 17053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:45751 every 8 connection(s)
I20260807 19:55:57.069106 16855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:55:57.071203 17054 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37179
I20260807 19:55:57.071521 17054 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:57.071704 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 16855
I20260807 19:55:57.071938 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:55:57.072441 17054 heartbeater.cc:511] Master 127.5.197.190:37179 requested a full tablet report, sending...
I20260807 19:55:57.072492 5910 external_mini_cluster.cc:1428] Setting key 8ebb31f10692a2e25f9aaf417e877caa
I20260807 19:55:57.074115 16551 ts_manager.cc:194] Registered new tserver with Master: eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751)
I20260807 19:55:57.075402 16551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:47267
WARNING: no policy specified for oryx/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab.
Entry for principal oryx/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab.
I20260807 19:55:57.134882 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37179
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab
--principal=oryx/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:55:57.485903 17059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:55:57.486224 17059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:55:57.486356 17059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:55:57.494064 17059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:55:57.494194 17059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:55:57.494318 17059 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:55:57.494426 17059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:55:57.504815 17059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab
--principal=oryx/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.197.190:37179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:55:57.506172 17059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:55:57.507552 17059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 19:55:57.516193 16850 heartbeater.cc:503] Master 127.5.197.190:37179 was elected leader, sending a full tablet report...
W20260807 19:55:57.521905 17066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:57.521867 17067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:55:57.521958 17069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:55:57.522907 17059 server_base.cc:1034] running on GCE node
I20260807 19:55:57.523574 17059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:55:57.524585 17059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:55:57.525802 17059 hybrid_clock.cc:648] HybridClock initialized: now 1786132557525727 us; error 69 us; skew 500 ppm
I20260807 19:55:57.526103 17059 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:55:57 dist-test-slave-6bbx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132557, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:55:57.529392 17059 init.cc:377] Logged in from keytab as oryx/127.5.197.131@KRBTEST.COM (short username oryx)
I20260807 19:55:57.530956 17059 webserver.cc:460] Webserver started at http://127.5.197.131:43457/ using document root <none> and password file <none>
I20260807 19:55:57.531724 17059 fs_manager.cc:359] Metadata directory not provided
I20260807 19:55:57.531826 17059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:55:57.532120 17059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:55:57.535166 17059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
format_stamp: "Formatted at 2026-08-07 19:55:57 on dist-test-slave-6bbx"
server_key: "36bc818caadcbc6e1559060e7a732158"
server_key_iv: "fe65f228e1ecc5257aac483e4b39bfc6"
server_key_version: "encryptionkey@0"
I20260807 19:55:57.536082 17059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
format_stamp: "Formatted at 2026-08-07 19:55:57 on dist-test-slave-6bbx"
server_key: "36bc818caadcbc6e1559060e7a732158"
server_key_iv: "fe65f228e1ecc5257aac483e4b39bfc6"
server_key_version: "encryptionkey@0"
I20260807 19:55:57.541687 17059 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:55:57.545583 17082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:57.547307 17059 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:55:57.547494 17059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
format_stamp: "Formatted at 2026-08-07 19:55:57 on dist-test-slave-6bbx"
server_key: "36bc818caadcbc6e1559060e7a732158"
server_key_iv: "fe65f228e1ecc5257aac483e4b39bfc6"
server_key_version: "encryptionkey@0"
I20260807 19:55:57.547762 17059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:55:57.567478 17059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:55:57.572086 17059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:55:57.572369 17059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:55:57.575762 17059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:55:57.575871 17059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:55:57.576009 17059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:55:57.576085 17059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:55:57 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132557, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:57.602916 17094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.576450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:60123 (local address 127.5.197.190:37179)
0807 19:55:57.580127 (+ 3677us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:57.580134 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:57.580768 (+ 634us) server_negotiation.cc:407] Connection header received
0807 19:55:57.583372 (+ 2604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:57.583380 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:57.583484 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:57.583576 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:57.585903 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.586692 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.589248 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.589937 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.590062 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.595473 (+ 5411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:57.595482 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:57.595487 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:57.595539 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:57.598618 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.599821 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.599826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.599828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.600005 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.600608 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.600612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.600614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.600938 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:57.601120 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:57.602280 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0807 19:55:57.602539 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3528,"thread_start_us":3423,"threads_started":1}
I20260807 19:55:57.604684 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.577027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37179 (local address 127.5.197.131:60123)
0807 19:55:57.580556 (+ 3529us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:57.580614 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:57.582906 (+ 2292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:57.584171 (+ 1265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:57.584184 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:57.584991 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:57.585714 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.585733 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.586881 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.586887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.589089 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.589106 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.590201 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.590209 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.590446 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.591278 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:57.591306 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:57.595099 (+ 3793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:57.598831 (+ 3732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.598842 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.598867 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.599616 (+ 749us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.600159 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.600167 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.600174 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.600473 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.601097 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:57.601107 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:57.601752 (+ 645us) client_negotiation.cc:769] Sending connection context
0807 19:55:57.602129 (+ 377us) client_negotiation.cc:240] Negotiation successful
0807 19:55:57.602867 (+ 738us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3244,"thread_start_us":2983,"threads_started":1}
I20260807 19:55:57.630278 17094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.613989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:55769 (local address 127.5.197.190:37179)
0807 19:55:57.614177 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:57.614184 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:57.614984 (+ 800us) server_negotiation.cc:407] Connection header received
0807 19:55:57.615319 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:57.615326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:57.615433 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:57.615550 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:57.616758 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.617951 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.619532 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.620208 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.620361 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.622768 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:57.622775 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:57.622780 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:57.622827 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:57.626783 (+ 3956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.627845 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.627851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.627855 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.628057 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:57.628481 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:57.628486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:57.628489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:57.628867 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:57.629044 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:57.629625 (+ 581us) server_negotiation.cc:299] Negotiation successful
0807 19:55:57.629897 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 19:55:57.630457 17204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:57.614048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37179 (local address 127.5.197.131:55769)
0807 19:55:57.614857 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:57.614880 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:57.615123 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:57.615613 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:57.615618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:57.616280 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:57.616592 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.616603 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.618143 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.618148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.619400 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:57.619416 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.620433 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.620440 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:57.620630 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:57.621485 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:57.621516 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:57.622503 (+ 987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:57.626986 (+ 4483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.626992 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.626997 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.627713 (+ 716us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.628202 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:57.628208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:57.628211 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:57.628363 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:57.629001 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:57.629006 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:57.629315 (+ 309us) client_negotiation.cc:769] Sending connection context
0807 19:55:57.629483 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 19:55:57.629896 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":439,"threads_started":1}
I20260807 19:55:57.630498 17059 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:45735
I20260807 19:55:57.630522 17276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:45735 every 8 connection(s)
I20260807 19:55:57.632022 17059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:55:57.634625 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 17059
I20260807 19:55:57.634837 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:55:57.634178 17277 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37179
I20260807 19:55:57.635334 17277 heartbeater.cc:464] Registering TS with master...
I20260807 19:55:57.635352 5910 external_mini_cluster.cc:1428] Setting key 1c96aba680f696443f732c2450590b72
I20260807 19:55:57.636139 17277 heartbeater.cc:511] Master 127.5.197.190:37179 requested a full tablet report, sending...
I20260807 19:55:57.637674 16551 ts_manager.cc:194] Registered new tserver with Master: a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:55:57.638693 16551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:60123
I20260807 19:55:57.638777 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:55:57 dist-test-slave-6bbx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:55:57 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:55:57 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:55:58.078678 17054 heartbeater.cc:503] Master 127.5.197.190:37179 was elected leader, sending a full tablet report...
I20260807 19:55:58.641827 17277 heartbeater.cc:503] Master 127.5.197.190:37179 was elected leader, sending a full tablet report...
W20260807 19:55:58.768081 17291 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.068s user 0.007s sys 0.014s
W20260807 19:55:58.769469 17094 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:57.693975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45150 (local address 127.5.197.190:37179)
0807 19:55:57.694149 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:57.694154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:57.694485 (+ 331us) server_negotiation.cc:407] Connection header received
0807 19:55:57.694648 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:57.694652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:57.694739 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:57.694845 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:57.696366 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.697211 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.698534 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:57.698989 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:57.699093 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.769076 (+1069983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45150: BlockingRecv error: recv got EOF from 127.0.0.1:45150 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 19:55:58 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:58.795570 17094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.777439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45162 (local address 127.5.197.190:37179)
0807 19:55:58.777652 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:58.777659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:58.777937 (+ 278us) server_negotiation.cc:407] Connection header received
0807 19:55:58.778130 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:58.778136 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:58.778207 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:58.778297 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:58.779630 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.780424 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.781750 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.782212 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.782329 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.789851 (+ 7522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:58.789858 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:58.789861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:58.789907 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:58.793056 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:58.793806 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:58.793810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:58.793812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:58.793972 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:58.794331 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:58.794336 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:58.794338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:58.794620 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:58.794823 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:58.795069 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 19:55:58.795267 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 19:55:58.799790 16551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45162:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:58.807228 16551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:58.857137 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.821629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.5.197.131:45735)
0807 19:55:58.844592 (+ 22963us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:58.844605 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:58.845769 (+ 1164us) server_negotiation.cc:407] Connection header received
0807 19:55:58.845910 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:58.845919 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:58.846256 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:58.846501 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:58.847561 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.849696 (+ 2135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.853658 (+ 3962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.855237 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.855367 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.855583 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:58.856667 (+ 1084us) server_negotiation.cc:299] Negotiation successful
0807 19:55:58.856847 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22722,"thread_start_us":22995,"threads_started":1}
I20260807 19:55:58.857939 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.821008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:45735 (local address 127.0.0.1:53012)
0807 19:55:58.845379 (+ 24371us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:58.845404 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:58.845589 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:58.846816 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:58.846826 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:58.846865 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:58.847347 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.847360 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.849893 (+ 2533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.849900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.853441 (+ 3541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.853456 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.856151 (+ 2695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.856160 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.856391 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.856455 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 19:55:58.856617 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 19:55:58.856825 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24212,"thread_start_us":28164,"threads_started":1}
I20260807 19:55:58.860805 17312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.820627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55812 (local address 127.5.197.129:42285)
0807 19:55:58.852541 (+ 31914us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:58.852550 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:58.852584 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:55:58.852772 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:58.852781 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:58.853099 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:58.853312 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:58.854108 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.855565 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.858735 (+ 3170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.859758 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.859909 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.860126 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:58.860346 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 19:55:58.860521 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31730,"thread_start_us":31570,"threads_started":1}
I20260807 19:55:58.860817 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.820411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:42285 (local address 127.0.0.1:55812)
0807 19:55:58.821493 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:58.821551 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:58.821750 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:58.853312 (+ 31562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:58.853317 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:58.853357 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:58.853887 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.853904 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.855739 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.855745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.858567 (+ 2822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.858581 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.859993 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.860000 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.860173 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.860198 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:55:58.860289 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 19:55:58.860431 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":22,"thread_start_us":587,"threads_started":1}
I20260807 19:55:58.862712 17316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.821884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:45751 (local address 127.0.0.1:42972)
0807 19:55:58.852865 (+ 30981us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:58.852884 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:58.853021 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:58.853657 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:58.853662 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:58.853690 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:58.854120 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.854129 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.855862 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.855866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.859812 (+ 3946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.859827 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.861845 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.861853 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.862025 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.862065 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 19:55:58.862179 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 19:55:58.862311 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30851,"mutex_wait_us":2,"thread_start_us":30698,"threads_started":1}
I20260807 19:55:58.862726 17317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.822216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.5.197.130:45751)
0807 19:55:58.852769 (+ 30553us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:58.852778 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:58.853001 (+ 223us) server_negotiation.cc:407] Connection header received
0807 19:55:58.853176 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:58.853184 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:58.853414 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:58.853604 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:58.854288 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.855322 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.860012 (+ 4690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.861596 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.861743 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.861949 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:58.862243 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 19:55:58.862431 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29673,"thread_start_us":29515,"threads_started":1}
I20260807 19:55:58.865293 16762 tablet_service.cc:1467] Processing CreateTablet for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d (DEFAULT_TABLE table=test-table [id=0213fde97b3e40f79d4bd3cc6f6eacc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:58.866269 16955 tablet_service.cc:1467] Processing CreateTablet for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d (DEFAULT_TABLE table=test-table [id=0213fde97b3e40f79d4bd3cc6f6eacc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:58.866871 16762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:58.867487 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:58.872942 17161 tablet_service.cc:1467] Processing CreateTablet for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d (DEFAULT_TABLE table=test-table [id=0213fde97b3e40f79d4bd3cc6f6eacc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:58.874626 17161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:58.882184 17319 tablet_bootstrap.cc:492] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Bootstrap starting.
I20260807 19:55:58.884265 17321 tablet_bootstrap.cc:492] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Bootstrap starting.
I20260807 19:55:58.886163 17319 tablet_bootstrap.cc:654] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:58.887529 17319 log.cc:824] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:58.887823 17321 tablet_bootstrap.cc:654] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:58.889142 17323 tablet_bootstrap.cc:492] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Bootstrap starting.
I20260807 19:55:58.889947 17321 log.cc:824] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:58.891551 17319 tablet_bootstrap.cc:492] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: No bootstrap required, opened a new log
I20260807 19:55:58.891912 17319 ts_tablet_manager.cc:1397] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 19:55:58.892392 17323 tablet_bootstrap.cc:654] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:58.893210 17321 tablet_bootstrap.cc:492] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: No bootstrap required, opened a new log
I20260807 19:55:58.893412 17323 log.cc:824] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Log is configured to *not* fsync() on all Append() calls
I20260807 19:55:58.893510 17321 ts_tablet_manager.cc:1397] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260807 19:55:58.896239 17323 tablet_bootstrap.cc:492] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: No bootstrap required, opened a new log
I20260807 19:55:58.896510 17323 ts_tablet_manager.cc:1397] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260807 19:55:58.903009 17319 raft_consensus.cc:348] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.903518 17319 raft_consensus.cc:374] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:58.903700 17319 raft_consensus.cc:729] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0b1f9e2bfb40e2b57810535f529d91, State: Initialized, Role: FOLLOWER
I20260807 19:55:58.903997 17323 raft_consensus.cc:348] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.904410 17323 raft_consensus.cc:374] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:58.904160 17321 raft_consensus.cc:348] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.904515 17323 raft_consensus.cc:729] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a50dd5fc7dc345e0b0a7eea83eba1ec3, State: Initialized, Role: FOLLOWER
I20260807 19:55:58.904635 17321 raft_consensus.cc:374] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:58.904510 17319 consensus_queue.cc:260] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.904753 17321 raft_consensus.cc:729] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Initialized, Role: FOLLOWER
I20260807 19:55:58.905146 17323 consensus_queue.cc:260] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.905385 17321 consensus_queue.cc:260] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.906751 17323 ts_tablet_manager.cc:1428] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent starting tablet: real 0.010s user 0.003s sys 0.007s
I20260807 19:55:58.908366 17321 ts_tablet_manager.cc:1428] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260807 19:55:58.910149 17319 ts_tablet_manager.cc:1428] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent starting tablet: real 0.018s user 0.014s sys 0.000s
I20260807 19:55:58.968364 17332 raft_consensus.cc:482] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:58.968743 17332 raft_consensus.cc:504] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.970908 17332 leader_election.cc:288] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:55:58.978523 17333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.971353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:45735 (local address 127.5.197.130:55767)
0807 19:55:58.972118 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:58.972139 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:58.972317 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:58.972855 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:58.972860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:58.972889 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:58.973234 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.973245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.974724 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.974728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.976246 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.976260 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.977926 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.977931 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.978054 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.978078 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:55:58.978150 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 19:55:58.978252 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":415,"threads_started":1}
I20260807 19:55:58.978617 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.971986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:55767 (local address 127.5.197.131:45735)
0807 19:55:58.972178 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:58.972185 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:58.972213 (+ 28us) server_negotiation.cc:407] Connection header received
0807 19:55:58.972646 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:58.972651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:58.972725 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:58.972808 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:58.973399 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.974580 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.976402 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.977699 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.977865 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.977947 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:58.978192 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 19:55:58.978339 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:55:58.979653 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88208eb65bcc4a5fbc6fe86c3a4d981d" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" is_pre_election: true
I20260807 19:55:58.980299 17195 raft_consensus.cc:2454] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 0.
I20260807 19:55:58.981079 16887 leader_election.cc:302] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a50dd5fc7dc345e0b0a7eea83eba1ec3, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:55:58.981541 17332 raft_consensus.cc:2781] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:58.981712 17332 raft_consensus.cc:482] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:58.981835 17332 raft_consensus.cc:3037] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:58.984670 17312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.971401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:35743 (local address 127.5.197.129:42285)
0807 19:55:58.971653 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:58.971659 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:58.979025 (+ 7366us) server_negotiation.cc:407] Connection header received
0807 19:55:58.979364 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:58.979371 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:58.979452 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:58.979555 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:58.979879 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.980877 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.982966 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.983906 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.984025 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.984079 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:58.984396 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 19:55:58.984491 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:55:58.984771 17333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:58.971402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:42285 (local address 127.5.197.130:35743)
0807 19:55:58.978920 (+ 7518us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:58.978937 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:58.979139 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:58.979561 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:58.979564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:58.979584 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:58.979749 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.979758 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.981006 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.981010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.982808 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:58.982824 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:58.984054 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:58.984060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:58.984240 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:58.984274 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:55:58.984377 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 19:55:58.984505 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7420,"thread_start_us":8567,"threads_started":1}
I20260807 19:55:58.984769 17332 raft_consensus.cc:504] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.985687 17332 leader_election.cc:288] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 election: Requested vote from peers 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:55:58.986050 16789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88208eb65bcc4a5fbc6fe86c3a4d981d" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0b1f9e2bfb40e2b57810535f529d91"
I20260807 19:55:58.985996 16790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88208eb65bcc4a5fbc6fe86c3a4d981d" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" is_pre_election: true
I20260807 19:55:58.986334 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88208eb65bcc4a5fbc6fe86c3a4d981d" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
I20260807 19:55:58.986546 17195 raft_consensus.cc:3037] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:58.986593 16790 raft_consensus.cc:2454] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 0.
I20260807 19:55:58.989240 17195 raft_consensus.cc:2454] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 1.
I20260807 19:55:58.989596 16887 leader_election.cc:302] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a50dd5fc7dc345e0b0a7eea83eba1ec3, eb7afe675c0c43c7aa09a0ff39f35588; no voters: 4c0b1f9e2bfb40e2b57810535f529d91
I20260807 19:55:58.989879 17332 raft_consensus.cc:2781] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:58.990322 17332 raft_consensus.cc:686] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 LEADER]: Becoming Leader. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Running, Role: LEADER
I20260807 19:55:58.990804 17332 consensus_queue.cc:237] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:58.995445 16550 catalog_manager.cc:5495] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } health_report { overall_health: UNKNOWN } } }
W20260807 19:55:59.010648 16852 tablet.cc:2369] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:59.015417 17317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.010362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42982 (local address 127.5.197.130:45751)
0807 19:55:59.010594 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.010599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.010624 (+ 25us) server_negotiation.cc:407] Connection header received
0807 19:55:59.010872 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.010878 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.010993 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.011229 (+ 236us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:59.011511 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.012284 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.013538 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.013948 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.014039 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.014393 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.014933 (+ 540us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.015045 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.015102 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.015207 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 19:55:59.023622 16789 raft_consensus.cc:3037] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:59.023962 17195 raft_consensus.cc:1261] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Refusing update from remote peer eb7afe675c0c43c7aa09a0ff39f35588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:59.024881 17335 consensus_queue.cc:1035] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:59.026580 16789 raft_consensus.cc:1261] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Refusing update from remote peer eb7afe675c0c43c7aa09a0ff39f35588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:59.027328 17335 consensus_queue.cc:1035] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:59.040097 17347 mvcc.cc:205] Tried to move back new op lower bound from 7315998961751437312 to 7315998961630228480. Current Snapshot: MvccSnapshot[applied={T|T < 7315998961751437312}]
I20260807 19:55:59.052366 16550 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:59.052647 16550 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:59.056135 16550 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Sending DeleteTablet for 3 replicas of tablet 88208eb65bcc4a5fbc6fe86c3a4d981d
I20260807 19:55:59.057358 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:59 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:42972
I20260807 19:55:59.057451 16762 tablet_service.cc:1514] Processing DeleteTablet for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:59 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:55812
I20260807 19:55:59.058374 17161 tablet_service.cc:1514] Processing DeleteTablet for tablet 88208eb65bcc4a5fbc6fe86c3a4d981d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:59 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:53012
I20260807 19:55:59.058420 16550 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45162:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:59.059128 16550 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:59.061916 17361 tablet_replica.cc:330] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: stopping tablet replica
I20260807 19:55:59.062409 17361 raft_consensus.cc:2229] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:59.064606 17361 raft_consensus.cc:2258] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:59.065423 17359 tablet_replica.cc:330] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: stopping tablet replica
I20260807 19:55:59.066959 17359 raft_consensus.cc:2229] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:59.067632 17359 raft_consensus.cc:2258] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:59.067745 16760 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6247d923b40e8bf6df19d60e730b2 (DEFAULT_TABLE table=test-table [id=a95d7aaeb5f44cd6ab0fa914750542e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:59.068512 16760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6247d923b40e8bf6df19d60e730b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.069689 16955 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6247d923b40e8bf6df19d60e730b2 (DEFAULT_TABLE table=test-table [id=a95d7aaeb5f44cd6ab0fa914750542e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:59.070243 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6247d923b40e8bf6df19d60e730b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.072301 17161 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6247d923b40e8bf6df19d60e730b2 (DEFAULT_TABLE table=test-table [id=a95d7aaeb5f44cd6ab0fa914750542e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:59.072767 17161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6247d923b40e8bf6df19d60e730b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.085433 17319 tablet_bootstrap.cc:492] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: Bootstrap starting.
I20260807 19:55:59.087100 17319 tablet_bootstrap.cc:654] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:59.087126 17359 ts_tablet_manager.cc:1905] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:59.087978 17323 tablet_bootstrap.cc:492] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Bootstrap starting.
I20260807 19:55:59.090643 17361 ts_tablet_manager.cc:1905] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:59.090947 17323 tablet_bootstrap.cc:654] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:59.093953 17321 tablet_bootstrap.cc:492] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Bootstrap starting.
I20260807 19:55:59.095647 17321 tablet_bootstrap.cc:654] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:59.095855 17359 ts_tablet_manager.cc:1918] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:59.096038 17359 log.cc:1196] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/88208eb65bcc4a5fbc6fe86c3a4d981d
I20260807 19:55:59.096597 17359 ts_tablet_manager.cc:1939] T 88208eb65bcc4a5fbc6fe86c3a4d981d P eb7afe675c0c43c7aa09a0ff39f35588: Deleting consensus metadata
I20260807 19:55:59.098806 16529 catalog_manager.cc:4841] TS eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751): tablet 88208eb65bcc4a5fbc6fe86c3a4d981d (table test-table [id=0213fde97b3e40f79d4bd3cc6f6eacc5]) successfully deleted
I20260807 19:55:59.104494 17360 tablet_replica.cc:330] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: stopping tablet replica
I20260807 19:55:59.105417 17360 raft_consensus.cc:2229] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:59.105979 17360 raft_consensus.cc:2258] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:59.108620 17323 tablet_bootstrap.cc:492] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: No bootstrap required, opened a new log
I20260807 19:55:59.108776 17323 ts_tablet_manager.cc:1397] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.004s
I20260807 19:55:59.109539 17323 raft_consensus.cc:348] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.109760 17323 raft_consensus.cc:374] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:59.109840 17323 raft_consensus.cc:729] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a50dd5fc7dc345e0b0a7eea83eba1ec3, State: Initialized, Role: FOLLOWER
I20260807 19:55:59.110181 17321 tablet_bootstrap.cc:492] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: No bootstrap required, opened a new log
I20260807 19:55:59.110085 17323 consensus_queue.cc:260] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.110325 17321 ts_tablet_manager.cc:1397] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.008s
I20260807 19:55:59.110597 17323 ts_tablet_manager.cc:1428] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 19:55:59.111198 17321 raft_consensus.cc:348] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.111433 17321 raft_consensus.cc:374] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:59.111533 17321 raft_consensus.cc:729] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Initialized, Role: FOLLOWER
I20260807 19:55:59.111814 17321 consensus_queue.cc:260] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.114380 17361 ts_tablet_manager.cc:1918] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:59.114459 17321 ts_tablet_manager.cc:1428] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260807 19:55:59.114552 17361 log.cc:1196] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/88208eb65bcc4a5fbc6fe86c3a4d981d
I20260807 19:55:59.115099 17361 ts_tablet_manager.cc:1939] T 88208eb65bcc4a5fbc6fe86c3a4d981d P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting consensus metadata
I20260807 19:55:59.117005 16527 catalog_manager.cc:4841] TS a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735): tablet 88208eb65bcc4a5fbc6fe86c3a4d981d (table test-table [id=0213fde97b3e40f79d4bd3cc6f6eacc5]) successfully deleted
I20260807 19:55:59.118355 17319 tablet_bootstrap.cc:492] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: No bootstrap required, opened a new log
I20260807 19:55:59.118527 17319 ts_tablet_manager.cc:1397] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.004s
I20260807 19:55:59.119277 17319 raft_consensus.cc:348] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.119463 17319 raft_consensus.cc:374] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:59.119553 17360 ts_tablet_manager.cc:1905] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:59.119566 17319 raft_consensus.cc:729] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0b1f9e2bfb40e2b57810535f529d91, State: Initialized, Role: FOLLOWER
I20260807 19:55:59.119992 17319 consensus_queue.cc:260] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.120777 17319 ts_tablet_manager.cc:1428] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 19:55:59.126971 17360 ts_tablet_manager.cc:1918] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:55:59.127153 17360 log.cc:1196] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/88208eb65bcc4a5fbc6fe86c3a4d981d
I20260807 19:55:59.127763 17360 ts_tablet_manager.cc:1939] T 88208eb65bcc4a5fbc6fe86c3a4d981d P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting consensus metadata
I20260807 19:55:59.129631 16529 catalog_manager.cc:4841] TS 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285): tablet 88208eb65bcc4a5fbc6fe86c3a4d981d (table test-table [id=0213fde97b3e40f79d4bd3cc6f6eacc5]) successfully deleted
W20260807 19:55:59.136031 17279 tablet.cc:2369] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:59.165525 17330 raft_consensus.cc:482] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:59.165829 17330 raft_consensus.cc:504] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.167840 17330 leader_election.cc:288] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:55:59.176959 17317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.168243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58935 (local address 127.5.197.130:45751)
0807 19:55:59.168505 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.168512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.169691 (+ 1179us) server_negotiation.cc:407] Connection header received
0807 19:55:59.169872 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.169878 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.169960 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.170078 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:59.170747 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.171597 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.174537 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.175910 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.176074 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.176169 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.176490 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.176639 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260807 19:55:59.176983 17369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.168698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:45751 (local address 127.5.197.129:58935)
0807 19:55:59.169580 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:59.169597 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:59.169717 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:59.170107 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:59.170112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:59.170133 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:59.170579 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.170592 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.171728 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.171733 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.174366 (+ 2633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.174376 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.176126 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.176133 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.176312 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.176349 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:55:59.176447 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 19:55:59.176583 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"mutex_wait_us":147,"thread_start_us":572,"threads_started":1}
I20260807 19:55:59.178177 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.168276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:59405 (local address 127.5.197.131:45735)
0807 19:55:59.168463 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.168470 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.169332 (+ 862us) server_negotiation.cc:407] Connection header received
0807 19:55:59.169653 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.169659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.169739 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.169834 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:55:59.170564 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.171731 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.175784 (+ 4053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.176928 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.177245 (+ 317us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.177321 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.177778 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.177928 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 19:55:59.178205 17368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.168567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:45735 (local address 127.5.197.129:59405)
0807 19:55:59.169215 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:59.169239 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:59.169473 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:59.169907 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:59.169911 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:59.169937 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:55:59.170376 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.170390 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.171869 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.171874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.174360 (+ 2486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.174377 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.177453 (+ 3076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.177457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.177571 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.177594 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 19:55:59.177724 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 19:55:59.177861 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":68,"thread_start_us":317,"threads_started":1}
I20260807 19:55:59.178098 16984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6247d923b40e8bf6df19d60e730b2" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" is_pre_election: true
I20260807 19:55:59.178680 16984 raft_consensus.cc:2454] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 0.
I20260807 19:55:59.179029 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6247d923b40e8bf6df19d60e730b2" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" is_pre_election: true
I20260807 19:55:59.179260 17195 raft_consensus.cc:2454] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 0.
I20260807 19:55:59.179286 16680 leader_election.cc:302] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0b1f9e2bfb40e2b57810535f529d91, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:55:59.179677 17330 raft_consensus.cc:2781] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:59.179807 17330 raft_consensus.cc:482] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:59.179911 17330 raft_consensus.cc:3037] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:59.182098 17330 raft_consensus.cc:504] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.182788 17330 leader_election.cc:288] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 election: Requested vote from peers eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:55:59.183274 16984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6247d923b40e8bf6df19d60e730b2" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7afe675c0c43c7aa09a0ff39f35588"
I20260807 19:55:59.183480 16984 raft_consensus.cc:3037] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:59.183802 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6247d923b40e8bf6df19d60e730b2" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
I20260807 19:55:59.184006 17195 raft_consensus.cc:3037] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:59.186801 17195 raft_consensus.cc:2454] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 1.
I20260807 19:55:59.186806 16984 raft_consensus.cc:2454] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 1.
I20260807 19:55:59.187178 16680 leader_election.cc:302] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0b1f9e2bfb40e2b57810535f529d91, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:55:59.187494 17330 raft_consensus.cc:2781] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:59.188019 17330 raft_consensus.cc:686] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 LEADER]: Becoming Leader. State: Replica: 4c0b1f9e2bfb40e2b57810535f529d91, State: Running, Role: LEADER
I20260807 19:55:59.188454 17330 consensus_queue.cc:237] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.192428 16550 catalog_manager.cc:5495] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } health_report { overall_health: UNKNOWN } } }
Aug 07 19:55:59 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132555, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.190@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:59.246104 17377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.230288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37179 (local address 127.0.0.1:45176)
0807 19:55:59.230934 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:59.230953 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:59.231082 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:59.231417 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:59.231421 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:59.232177 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:55:59.232490 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.232500 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.234036 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.234041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.235050 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.235062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.236062 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.236067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.236188 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.236921 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:55:59.236939 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:55:59.239418 (+ 2479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:55:59.243420 (+ 4002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:59.243433 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:59.243439 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:59.243994 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:59.244404 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:55:59.244408 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:55:59.244410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:55:59.244564 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:55:59.245206 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:55:59.245213 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:55:59.245379 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 19:55:59.245529 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 19:55:59.245775 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":361,"threads_started":1}
I20260807 19:55:59.246400 17094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.230274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45176 (local address 127.5.197.190:37179)
0807 19:55:59.230501 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.230508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.231045 (+ 537us) server_negotiation.cc:407] Connection header received
0807 19:55:59.231192 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.231197 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.231281 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.231401 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:59.232650 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.233877 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.235201 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.235862 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.236007 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.239629 (+ 3622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:59.239636 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:59.239641 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:59.239712 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:59.243231 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:59.244117 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:59.244123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:59.244126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:59.244282 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:59.244670 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:59.244676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:59.244680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:59.245047 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:59.245198 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.245664 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.245973 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":77}
I20260807 19:55:59.252297 16550 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:45176:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 19:55:59.253439 16550 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:59.260459 16762 tablet_service.cc:1467] Processing CreateTablet for tablet d063a4c38ba2494f8f7acae367860679 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=839af06302834cc79fef21fa68aca8cd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:59.260615 16955 tablet_service.cc:1467] Processing CreateTablet for tablet d063a4c38ba2494f8f7acae367860679 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=839af06302834cc79fef21fa68aca8cd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:59.261111 16762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d063a4c38ba2494f8f7acae367860679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.261214 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d063a4c38ba2494f8f7acae367860679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.266858 17321 tablet_bootstrap.cc:492] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: Bootstrap starting.
I20260807 19:55:59.268500 17321 tablet_bootstrap.cc:654] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:59.268813 17319 tablet_bootstrap.cc:492] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: Bootstrap starting.
I20260807 19:55:59.269853 17161 tablet_service.cc:1467] Processing CreateTablet for tablet d063a4c38ba2494f8f7acae367860679 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=839af06302834cc79fef21fa68aca8cd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:55:59.270438 17161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d063a4c38ba2494f8f7acae367860679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.270673 17319 tablet_bootstrap.cc:654] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:59.278136 17323 tablet_bootstrap.cc:492] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Bootstrap starting.
I20260807 19:55:59.279212 17319 tablet_bootstrap.cc:492] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: No bootstrap required, opened a new log
I20260807 19:55:59.279399 17319 ts_tablet_manager.cc:1397] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20260807 19:55:59.279793 17323 tablet_bootstrap.cc:654] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Neither blocks nor log segments found. Creating new log.
I20260807 19:55:59.280040 17321 tablet_bootstrap.cc:492] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: No bootstrap required, opened a new log
I20260807 19:55:59.280217 17321 ts_tablet_manager.cc:1397] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.007s
I20260807 19:55:59.280216 17319 raft_consensus.cc:348] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.280474 17319 raft_consensus.cc:374] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:59.280551 17319 raft_consensus.cc:729] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0b1f9e2bfb40e2b57810535f529d91, State: Initialized, Role: FOLLOWER
I20260807 19:55:59.280992 17321 raft_consensus.cc:348] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.281250 17321 raft_consensus.cc:374] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:59.281337 17321 raft_consensus.cc:729] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Initialized, Role: FOLLOWER
I20260807 19:55:59.281584 17321 consensus_queue.cc:260] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.282265 17321 ts_tablet_manager.cc:1428] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 19:55:59.282068 17332 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.282438 17332 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:59.283152 17319 consensus_queue.cc:260] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.283761 17330 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.284116 17330 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:59.283967 17319 ts_tablet_manager.cc:1428] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 19:55:59.289103 17323 tablet_bootstrap.cc:492] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: No bootstrap required, opened a new log
I20260807 19:55:59.289270 17323 ts_tablet_manager.cc:1397] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260807 19:55:59.289983 17323 raft_consensus.cc:348] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.290223 17323 raft_consensus.cc:374] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:55:59.290303 17323 raft_consensus.cc:729] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a50dd5fc7dc345e0b0a7eea83eba1ec3, State: Initialized, Role: FOLLOWER
I20260807 19:55:59.290553 17323 consensus_queue.cc:260] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.291190 17323 ts_tablet_manager.cc:1428] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 19:55:59.291033 17331 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.291471 17331 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 19:55:59.322371 17055 tablet.cc:2369] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:55:59.587303 17330 consensus_queue.cc:1035] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:59.593161 17370 consensus_queue.cc:1035] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:59.594553 17332 raft_consensus.cc:482] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:55:59.594744 17332 raft_consensus.cc:504] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.595296 17332 leader_election.cc:288] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:55:59.595729 16789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d063a4c38ba2494f8f7acae367860679" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" is_pre_election: true
I20260807 19:55:59.595995 16789 raft_consensus.cc:2454] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 0.
I20260807 19:55:59.595948 17194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d063a4c38ba2494f8f7acae367860679" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" is_pre_election: true
I20260807 19:55:59.596312 17194 raft_consensus.cc:2454] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 0.
I20260807 19:55:59.596689 16890 leader_election.cc:302] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0b1f9e2bfb40e2b57810535f529d91, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:55:59.597151 17332 raft_consensus.cc:2781] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:55:59.597259 17332 raft_consensus.cc:482] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:55:59.597368 17332 raft_consensus.cc:3037] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:59.599795 17332 raft_consensus.cc:504] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.600358 17332 leader_election.cc:288] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 election: Requested vote from peers 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:55:59.600755 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d063a4c38ba2494f8f7acae367860679" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
I20260807 19:55:59.600994 17195 raft_consensus.cc:3037] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:59.601027 16789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d063a4c38ba2494f8f7acae367860679" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0b1f9e2bfb40e2b57810535f529d91"
I20260807 19:55:59.601261 16789 raft_consensus.cc:3037] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:55:59.603138 17195 raft_consensus.cc:2454] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 1.
I20260807 19:55:59.603464 16789 raft_consensus.cc:2454] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 1.
I20260807 19:55:59.603556 16887 leader_election.cc:302] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a50dd5fc7dc345e0b0a7eea83eba1ec3, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:55:59.603960 17332 raft_consensus.cc:2781] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:55:59.604326 17332 raft_consensus.cc:686] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 LEADER]: Becoming Leader. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Running, Role: LEADER
I20260807 19:55:59.604579 17332 consensus_queue.cc:237] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:55:59.606179 17394 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: TxnStatusTablet state changed. Reason: New leader eb7afe675c0c43c7aa09a0ff39f35588. Latest consensus state: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.606469 17394 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:59.607152 17396 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 19:55:59.607363 17396 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 19:55:59.607519 16550 catalog_manager.cc:5495] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } health_report { overall_health: UNKNOWN } } }
I20260807 19:55:59.655421 17317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.649282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42990 (local address 127.5.197.130:45751)
0807 19:55:59.649477 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.649482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.649500 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:55:59.649803 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.649809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.649900 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.649999 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:59.650453 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.651657 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.653658 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.654096 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.654191 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.654774 (+ 583us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.654881 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.654952 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.655097 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.655167 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:55:59.655601 17377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.649171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:45751 (local address 127.0.0.1:42990)
0807 19:55:59.649428 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:59.649449 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:59.649596 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:59.650059 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:59.650064 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:59.650079 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:59.650297 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.650308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.651822 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.651828 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.653505 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.653521 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.654270 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.654277 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.654512 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.654597 (+ 85us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.654976 (+ 379us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.654998 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 19:55:59.655085 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 19:55:59.655265 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 19:55:59.659801 16789 raft_consensus.cc:1261] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Refusing update from remote peer eb7afe675c0c43c7aa09a0ff39f35588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:59.659828 17195 raft_consensus.cc:1261] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Refusing update from remote peer eb7afe675c0c43c7aa09a0ff39f35588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:55:59.660486 17332 consensus_queue.cc:1035] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:59.660832 17394 consensus_queue.cc:1035] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:55:59.663897 17370 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: TxnStatusTablet state changed. Reason: New leader eb7afe675c0c43c7aa09a0ff39f35588. Latest consensus state: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.664192 17370 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:59.664611 17331 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: TxnStatusTablet state changed. Reason: New leader eb7afe675c0c43c7aa09a0ff39f35588. Latest consensus state: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.664906 17331 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:59.666656 17390 mvcc.cc:205] Tried to move back new op lower bound from 7315998964359364608 to 7315998964142776320. Current Snapshot: MvccSnapshot[applied={T|T < 7315998964359364608}]
I20260807 19:55:59.670027 17332 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.670105 17331 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.670326 17331 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P a50dd5fc7dc345e0b0a7eea83eba1ec3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:59.670347 17332 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:59.670596 17332 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.670832 17332 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P eb7afe675c0c43c7aa09a0ff39f35588: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:55:59.674729 17393 mvcc.cc:205] Tried to move back new op lower bound from 7315998964359364608 to 7315998964142776320. Current Snapshot: MvccSnapshot[applied={T|T < 7315998964359364608}]
I20260807 19:55:59.677532 17370 tablet_replica.cc:439] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } }
I20260807 19:55:59.677809 17370 tablet_replica.cc:442] T d063a4c38ba2494f8f7acae367860679 P 4c0b1f9e2bfb40e2b57810535f529d91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:55:59.685473 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.678734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55822 (local address 127.5.197.129:42285)
0807 19:55:59.679172 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.679178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.679696 (+ 518us) server_negotiation.cc:407] Connection header received
0807 19:55:59.679800 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.679804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.679881 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.680017 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:59.680486 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.681190 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.683103 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.683567 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.683706 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.684292 (+ 586us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.684866 (+ 574us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.684986 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.685097 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.685165 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":201,"threads_started":1}
I20260807 19:55:59.701632 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.695458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:45751 (local address 127.5.197.129:39461)
0807 19:55:59.696134 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:59.696150 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:59.696265 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:59.696621 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:59.696625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:59.696636 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:59.696911 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.696919 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.698405 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.698409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.699487 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.699500 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.700502 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.700507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.700632 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.700703 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.701116 (+ 413us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.701123 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 19:55:59.701250 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 19:55:59.701357 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":363,"threads_started":1}
I20260807 19:55:59.701676 17317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.695459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:39461 (local address 127.5.197.130:45751)
0807 19:55:59.695711 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.695719 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.696292 (+ 573us) server_negotiation.cc:407] Connection header received
0807 19:55:59.696371 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.696376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.696471 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.696568 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:59.697062 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.698255 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.699629 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.700345 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.700469 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.700866 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.701032 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.701121 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.701285 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.701370 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:55:59.747736 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.742093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:43787 (local address 127.5.197.129:42285)
0807 19:55:59.742290 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.742297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.742595 (+ 298us) server_negotiation.cc:407] Connection header received
0807 19:55:59.742827 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.742832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.742922 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.743026 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:55:59.743723 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.744459 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.746004 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.746441 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.746551 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.747008 (+ 457us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.747113 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.747188 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.747336 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.747417 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:55:59.748097 17413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.741790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:42285 (local address 127.5.197.130:43787)
0807 19:55:59.742497 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0807 19:55:59.742518 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:55:59.742690 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:55:59.743064 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:55:59.743069 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:55:59.743082 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:55:59.743483 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.743500 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.744620 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.744626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.745857 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:55:59.745872 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.746615 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.746622 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:55:59.746748 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.746807 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:55:59.747222 (+ 415us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:55:59.747234 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 19:55:59.747303 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 19:55:59.747446 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":419,"threads_started":1}
I20260807 19:55:59.793160 16550 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:59.793462 16550 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:55:59.797117 16550 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Sending DeleteTablet for 3 replicas of tablet 17d6247d923b40e8bf6df19d60e730b2
I20260807 19:55:59.798404 17161 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6247d923b40e8bf6df19d60e730b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:59 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:53012
I20260807 19:55:59.798450 16762 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6247d923b40e8bf6df19d60e730b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:59 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:55812
I20260807 19:55:59.806924 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6247d923b40e8bf6df19d60e730b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:55:59 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:42972
I20260807 19:55:59.809077 17421 tablet_replica.cc:330] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: stopping tablet replica
I20260807 19:55:59.809319 17421 raft_consensus.cc:2229] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:59.809631 17421 raft_consensus.cc:2258] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:59.812565 17421 ts_tablet_manager.cc:1905] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:59.822160 17420 tablet_replica.cc:330] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: stopping tablet replica
I20260807 19:55:59.822613 17420 raft_consensus.cc:2229] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:55:59.823395 17420 raft_consensus.cc:2258] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:59.827526 17420 ts_tablet_manager.cc:1905] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:59.827574 17421 ts_tablet_manager.cc:1918] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:59.827792 17421 log.cc:1196] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/17d6247d923b40e8bf6df19d60e730b2
I20260807 19:55:59.828171 17419 tablet_replica.cc:330] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: stopping tablet replica
I20260807 19:55:59.828325 17421 ts_tablet_manager.cc:1939] T 17d6247d923b40e8bf6df19d60e730b2 P eb7afe675c0c43c7aa09a0ff39f35588: Deleting consensus metadata
I20260807 19:55:59.829635 16529 catalog_manager.cc:4841] TS eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751): tablet 17d6247d923b40e8bf6df19d60e730b2 (table test-table [id=a95d7aaeb5f44cd6ab0fa914750542e5]) successfully deleted
I20260807 19:55:59.830035 17419 raft_consensus.cc:2229] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:55:59.830296 17419 raft_consensus.cc:2258] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:55:59.832468 17419 ts_tablet_manager.cc:1905] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:55:59.841248 17420 ts_tablet_manager.cc:1918] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:59.841427 17420 log.cc:1196] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/17d6247d923b40e8bf6df19d60e730b2
I20260807 19:55:59.841946 17420 ts_tablet_manager.cc:1939] T 17d6247d923b40e8bf6df19d60e730b2 P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting consensus metadata
I20260807 19:55:59.841918 17419 ts_tablet_manager.cc:1918] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:55:59.842163 17419 log.cc:1196] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/17d6247d923b40e8bf6df19d60e730b2
I20260807 19:55:59.842758 17419 ts_tablet_manager.cc:1939] T 17d6247d923b40e8bf6df19d60e730b2 P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting consensus metadata
I20260807 19:55:59.843226 16529 catalog_manager.cc:4841] TS 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285): tablet 17d6247d923b40e8bf6df19d60e730b2 (table test-table [id=a95d7aaeb5f44cd6ab0fa914750542e5]) successfully deleted
I20260807 19:55:59.844033 16527 catalog_manager.cc:4841] TS a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735): tablet 17d6247d923b40e8bf6df19d60e730b2 (table test-table [id=a95d7aaeb5f44cd6ab0fa914750542e5]) successfully deleted
Aug 07 19:55:59 dist-test-slave-6bbx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:55:59 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:55:59 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:55:59.926698 17432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:55:59.897904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45188 (local address 127.5.197.190:37179)
0807 19:55:59.911045 (+ 13141us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.911052 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.911077 (+ 25us) server_negotiation.cc:407] Connection header received
0807 19:55:59.911161 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.911168 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.911259 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.911397 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:59.913352 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.914562 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.916484 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.917124 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.917268 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.926369 (+ 9101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45188: BlockingRecv error: recv got EOF from 127.0.0.1:45188 (error 108)
Metrics: {"server-negotiator.queue_time_us":13002,"thread_start_us":12834,"threads_started":1}
Aug 07 19:55:59 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM
I20260807 19:55:59.950585 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:55:59.929875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45204 (local address 127.5.197.190:37179)
0807 19:55:59.930051 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 19:55:59.930057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:55:59.932263 (+ 2206us) server_negotiation.cc:407] Connection header received
0807 19:55:59.932446 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:55:59.932452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:55:59.932544 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:55:59.932665 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:55:59.934298 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.935477 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.937478 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:55:59.938132 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:55:59.938275 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:55:59.943559 (+ 5284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:55:59.943566 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:55:59.943571 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:55:59.943634 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:55:59.947402 (+ 3768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:59.948359 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:59.948366 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:59.948370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:59.948546 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:55:59.948971 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:55:59.948977 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:55:59.948981 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:55:59.949349 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:55:59.949615 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 19:55:59.949965 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 19:55:59.950211 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:55:59.954933 16550 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:55:59.955753 16550 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:55:59.964161 17161 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc94722cfdd44d18125bb95e4e5e0cc (DEFAULT_TABLE table=test-table [id=49bd5fdaf26942839b724745dada38f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:59.964661 17161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc94722cfdd44d18125bb95e4e5e0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.968130 16955 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc94722cfdd44d18125bb95e4e5e0cc (DEFAULT_TABLE table=test-table [id=49bd5fdaf26942839b724745dada38f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:59.968475 16762 tablet_service.cc:1467] Processing CreateTablet for tablet 0cc94722cfdd44d18125bb95e4e5e0cc (DEFAULT_TABLE table=test-table [id=49bd5fdaf26942839b724745dada38f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:55:59.968632 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc94722cfdd44d18125bb95e4e5e0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.968968 16762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cc94722cfdd44d18125bb95e4e5e0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:55:59.996127 17449 tablet_bootstrap.cc:492] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: Bootstrap starting.
I20260807 19:55:59.998490 17449 tablet_bootstrap.cc:654] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:00.001341 17445 tablet_bootstrap.cc:492] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Bootstrap starting.
I20260807 19:56:00.004014 17445 tablet_bootstrap.cc:654] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:00.009359 17442 tablet_bootstrap.cc:492] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: Bootstrap starting.
I20260807 19:56:00.011530 17442 tablet_bootstrap.cc:654] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:00.016702 17449 tablet_bootstrap.cc:492] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: No bootstrap required, opened a new log
I20260807 19:56:00.016971 17449 ts_tablet_manager.cc:1397] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.008s
I20260807 19:56:00.017987 17449 raft_consensus.cc:348] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.018452 17449 raft_consensus.cc:374] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:00.018607 17449 raft_consensus.cc:729] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Initialized, Role: FOLLOWER
I20260807 19:56:00.019061 17449 consensus_queue.cc:260] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.022306 17449 ts_tablet_manager.cc:1428] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 19:56:00.023628 17445 tablet_bootstrap.cc:492] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: No bootstrap required, opened a new log
I20260807 19:56:00.023895 17445 ts_tablet_manager.cc:1397] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.000s
I20260807 19:56:00.024550 17442 tablet_bootstrap.cc:492] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: No bootstrap required, opened a new log
I20260807 19:56:00.024737 17442 ts_tablet_manager.cc:1397] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.003s
I20260807 19:56:00.025058 17445 raft_consensus.cc:348] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.025414 17445 raft_consensus.cc:374] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:00.025545 17445 raft_consensus.cc:729] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a50dd5fc7dc345e0b0a7eea83eba1ec3, State: Initialized, Role: FOLLOWER
I20260807 19:56:00.025668 17442 raft_consensus.cc:348] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.026021 17442 raft_consensus.cc:374] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:00.026129 17442 raft_consensus.cc:729] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0b1f9e2bfb40e2b57810535f529d91, State: Initialized, Role: FOLLOWER
I20260807 19:56:00.025867 17445 consensus_queue.cc:260] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.026420 17442 consensus_queue.cc:260] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.027046 17442 ts_tablet_manager.cc:1428] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 19:56:00.029078 17445 ts_tablet_manager.cc:1428] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 19:56:00.205123 17394 raft_consensus.cc:482] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:56:00.205348 17394 raft_consensus.cc:504] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.206027 17394 leader_election.cc:288] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:56:00.206750 16789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc94722cfdd44d18125bb95e4e5e0cc" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" is_pre_election: true
I20260807 19:56:00.206748 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc94722cfdd44d18125bb95e4e5e0cc" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" is_pre_election: true
I20260807 19:56:00.207049 17195 raft_consensus.cc:2454] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 0.
I20260807 19:56:00.207062 16789 raft_consensus.cc:2454] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 0.
I20260807 19:56:00.207629 16887 leader_election.cc:302] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a50dd5fc7dc345e0b0a7eea83eba1ec3, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:56:00.207964 17394 raft_consensus.cc:2781] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:56:00.208070 17394 raft_consensus.cc:482] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:56:00.208156 17394 raft_consensus.cc:3037] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:00.210153 17394 raft_consensus.cc:504] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.210731 17394 leader_election.cc:288] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 election: Requested vote from peers 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:56:00.211232 16789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc94722cfdd44d18125bb95e4e5e0cc" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0b1f9e2bfb40e2b57810535f529d91"
I20260807 19:56:00.211335 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cc94722cfdd44d18125bb95e4e5e0cc" candidate_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
I20260807 19:56:00.211515 16789 raft_consensus.cc:3037] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:00.211566 17195 raft_consensus.cc:3037] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:00.214500 17195 raft_consensus.cc:2454] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 1.
I20260807 19:56:00.214666 16789 raft_consensus.cc:2454] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7afe675c0c43c7aa09a0ff39f35588 in term 1.
I20260807 19:56:00.215039 16887 leader_election.cc:302] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a50dd5fc7dc345e0b0a7eea83eba1ec3, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:56:00.215335 17394 raft_consensus.cc:2781] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:56:00.215507 17394 raft_consensus.cc:686] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 LEADER]: Becoming Leader. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Running, Role: LEADER
I20260807 19:56:00.215801 17394 consensus_queue.cc:237] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } }
I20260807 19:56:00.218798 16550 catalog_manager.cc:5495] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } health_report { overall_health: UNKNOWN } } }
I20260807 19:56:00.288357 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:00.283535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43000 (local address 127.5.197.130:45751)
0807 19:56:00.284070 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:00.284077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:00.284096 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:56:00.284155 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:00.284158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:00.284223 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:00.284309 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:56:00.284684 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.285366 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.286695 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.287093 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.287219 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:00.287616 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:56:00.287768 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:56:00.287847 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:00.287986 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 19:56:00.288072 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":274,"threads_started":1}
I20260807 19:56:00.291311 16789 raft_consensus.cc:1261] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Refusing update from remote peer eb7afe675c0c43c7aa09a0ff39f35588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:56:00.291378 17195 raft_consensus.cc:1261] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Refusing update from remote peer eb7afe675c0c43c7aa09a0ff39f35588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:56:00.291968 17394 consensus_queue.cc:1035] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:56:00.292235 17332 consensus_queue.cc:1035] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:56:00.303726 16550 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:56:00.303938 16550 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:56:00.307206 16550 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Sending DeleteTablet for 3 replicas of tablet 0cc94722cfdd44d18125bb95e4e5e0cc
I20260807 19:56:00.308101 16762 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc94722cfdd44d18125bb95e4e5e0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:00 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:55812
I20260807 19:56:00.308264 17161 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc94722cfdd44d18125bb95e4e5e0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:00 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:53012
I20260807 19:56:00.308480 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cc94722cfdd44d18125bb95e4e5e0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:00 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:42972
I20260807 19:56:00.308759 17420 tablet_replica.cc:330] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: stopping tablet replica
I20260807 19:56:00.308962 17420 raft_consensus.cc:2229] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:56:00.309185 17420 raft_consensus.cc:2258] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:00.309466 17419 tablet_replica.cc:330] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: stopping tablet replica
I20260807 19:56:00.309675 17419 raft_consensus.cc:2229] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:56:00.309806 17419 pending_rounds.cc:62] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Trying to abort 2 pending ops.
W20260807 19:56:00.309926 17470 consensus_queue.cc:1159] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260807 19:56:00.309868 16550 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 19:56:00.309988 17419 pending_rounds.cc:68] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7315998966947332096 op_type: WRITE_OP write_request { tablet_id: "0cc94722cfdd44d18125bb95e4e5e0cc" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\374\362\330\323\006\"8\n\ntest-admin\022*\n 49bd5fdaf26942839b724745dada38f3\020\001\030\001 \001(\001" signature: "<redacted>""\221}\214\373\035\272\303\275q\206{\026\242\024_C(\"\305\036\262\363\247\274Jp(\304\262v\376U\326R\025\264\302\265\357*\241\323\230\237\363haW\0215\371\355V\030\323\331\333\355c\263\\\337\\\003" signing_key_seq_num: 0 } } request_id { client_id: "35f713be51274bd88bbb7c26a15d1b0e" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
W20260807 19:56:00.310516 16550 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:56:00.310776 17419 pending_rounds.cc:68] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315998966646755328 op_type: NO_OP noop_request { }
I20260807 19:56:00.310909 17419 raft_consensus.cc:2866] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260807 19:56:00.311053 17419 raft_consensus.cc:2258] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:00.311367 17421 tablet_replica.cc:330] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: stopping tablet replica
I20260807 19:56:00.311635 17421 raft_consensus.cc:2229] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:56:00.313444 17419 ts_tablet_manager.cc:1905] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:00.315240 17421 raft_consensus.cc:2258] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:00.316385 17420 ts_tablet_manager.cc:1905] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:00.319922 17419 ts_tablet_manager.cc:1918] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:56:00.320164 17419 log.cc:1196] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/0cc94722cfdd44d18125bb95e4e5e0cc
I20260807 19:56:00.320572 17419 ts_tablet_manager.cc:1939] T 0cc94722cfdd44d18125bb95e4e5e0cc P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting consensus metadata
I20260807 19:56:00.321821 16527 catalog_manager.cc:4841] TS a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735): tablet 0cc94722cfdd44d18125bb95e4e5e0cc (table test-table [id=49bd5fdaf26942839b724745dada38f3]) successfully deleted
I20260807 19:56:00.322556 17421 ts_tablet_manager.cc:1905] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:00.322753 17420 ts_tablet_manager.cc:1918] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:56:00.322912 17420 log.cc:1196] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/0cc94722cfdd44d18125bb95e4e5e0cc
I20260807 19:56:00.323268 17420 ts_tablet_manager.cc:1939] T 0cc94722cfdd44d18125bb95e4e5e0cc P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting consensus metadata
I20260807 19:56:00.324363 16529 catalog_manager.cc:4841] TS 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285): tablet 0cc94722cfdd44d18125bb95e4e5e0cc (table test-table [id=49bd5fdaf26942839b724745dada38f3]) successfully deleted
I20260807 19:56:00.328146 17421 ts_tablet_manager.cc:1918] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:56:00.328290 17421 log.cc:1196] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/0cc94722cfdd44d18125bb95e4e5e0cc
I20260807 19:56:00.328649 17421 ts_tablet_manager.cc:1939] T 0cc94722cfdd44d18125bb95e4e5e0cc P eb7afe675c0c43c7aa09a0ff39f35588: Deleting consensus metadata
I20260807 19:56:00.329667 16529 catalog_manager.cc:4841] TS eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751): tablet 0cc94722cfdd44d18125bb95e4e5e0cc (table test-table [id=49bd5fdaf26942839b724745dada38f3]) successfully deleted
I20260807 19:56:00.330693 16955 tablet_service.cc:1467] Processing CreateTablet for tablet 07ebf7bbb9c445e48e46efda834ce84f (DEFAULT_TABLE table=test-table [id=2d4cb44d4f1242879014e39f25e3d58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:56:00.330844 17161 tablet_service.cc:1467] Processing CreateTablet for tablet 07ebf7bbb9c445e48e46efda834ce84f (DEFAULT_TABLE table=test-table [id=2d4cb44d4f1242879014e39f25e3d58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:56:00.330896 16762 tablet_service.cc:1467] Processing CreateTablet for tablet 07ebf7bbb9c445e48e46efda834ce84f (DEFAULT_TABLE table=test-table [id=2d4cb44d4f1242879014e39f25e3d58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:56:00.331161 16955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ebf7bbb9c445e48e46efda834ce84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:00.331277 17161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ebf7bbb9c445e48e46efda834ce84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:00.331346 16762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ebf7bbb9c445e48e46efda834ce84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:00.336083 17442 tablet_bootstrap.cc:492] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: Bootstrap starting.
I20260807 19:56:00.337445 17445 tablet_bootstrap.cc:492] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: Bootstrap starting.
I20260807 19:56:00.337754 17442 tablet_bootstrap.cc:654] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:00.338771 17445 tablet_bootstrap.cc:654] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:00.340735 17449 tablet_bootstrap.cc:492] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: Bootstrap starting.
I20260807 19:56:00.341004 17445 tablet_bootstrap.cc:492] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: No bootstrap required, opened a new log
I20260807 19:56:00.341154 17445 ts_tablet_manager.cc:1397] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 19:56:00.341506 17442 tablet_bootstrap.cc:492] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: No bootstrap required, opened a new log
I20260807 19:56:00.341630 17442 ts_tablet_manager.cc:1397] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260807 19:56:00.341925 17445 raft_consensus.cc:348] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.342192 17445 raft_consensus.cc:374] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:00.342274 17445 raft_consensus.cc:729] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a50dd5fc7dc345e0b0a7eea83eba1ec3, State: Initialized, Role: FOLLOWER
I20260807 19:56:00.342233 17442 raft_consensus.cc:348] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.342434 17442 raft_consensus.cc:374] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:00.342455 17449 tablet_bootstrap.cc:654] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:00.342502 17442 raft_consensus.cc:729] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0b1f9e2bfb40e2b57810535f529d91, State: Initialized, Role: FOLLOWER
I20260807 19:56:00.342746 17442 consensus_queue.cc:260] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.342794 17445 consensus_queue.cc:260] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.343346 17442 ts_tablet_manager.cc:1428] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 19:56:00.344627 17445 ts_tablet_manager.cc:1428] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 19:56:00.347538 17449 tablet_bootstrap.cc:492] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: No bootstrap required, opened a new log
I20260807 19:56:00.347708 17449 ts_tablet_manager.cc:1397] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 19:56:00.348294 17449 raft_consensus.cc:348] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.348541 17449 raft_consensus.cc:374] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:00.348631 17449 raft_consensus.cc:729] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7afe675c0c43c7aa09a0ff39f35588, State: Initialized, Role: FOLLOWER
I20260807 19:56:00.348862 17449 consensus_queue.cc:260] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.349341 17449 ts_tablet_manager.cc:1428] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 19:56:00.578938 17387 raft_consensus.cc:482] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:56:00.579154 17387 raft_consensus.cc:504] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.579854 17387 leader_election.cc:288] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:56:00.580413 16984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ebf7bbb9c445e48e46efda834ce84f" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" is_pre_election: true
I20260807 19:56:00.580484 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ebf7bbb9c445e48e46efda834ce84f" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" is_pre_election: true
I20260807 19:56:00.580650 16984 raft_consensus.cc:2454] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 0.
I20260807 19:56:00.580756 17195 raft_consensus.cc:2454] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 0.
I20260807 19:56:00.581166 16679 leader_election.cc:302] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4c0b1f9e2bfb40e2b57810535f529d91, a50dd5fc7dc345e0b0a7eea83eba1ec3, eb7afe675c0c43c7aa09a0ff39f35588; no voters:
I20260807 19:56:00.581473 17387 raft_consensus.cc:2781] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:56:00.581578 17387 raft_consensus.cc:482] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:56:00.581645 17387 raft_consensus.cc:3037] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:00.583802 17387 raft_consensus.cc:504] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.584303 17387 leader_election.cc:288] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 election: Requested vote from peers eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751), a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735)
I20260807 19:56:00.584762 16984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ebf7bbb9c445e48e46efda834ce84f" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb7afe675c0c43c7aa09a0ff39f35588"
I20260807 19:56:00.584774 17195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ebf7bbb9c445e48e46efda834ce84f" candidate_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3"
I20260807 19:56:00.584978 16984 raft_consensus.cc:3037] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:00.584997 17195 raft_consensus.cc:3037] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:00.587544 16984 raft_consensus.cc:2454] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 1.
I20260807 19:56:00.587553 17195 raft_consensus.cc:2454] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0b1f9e2bfb40e2b57810535f529d91 in term 1.
I20260807 19:56:00.587977 16679 leader_election.cc:302] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c0b1f9e2bfb40e2b57810535f529d91, a50dd5fc7dc345e0b0a7eea83eba1ec3; no voters:
I20260807 19:56:00.588275 17387 raft_consensus.cc:2781] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:56:00.588672 17387 raft_consensus.cc:686] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 LEADER]: Becoming Leader. State: Replica: 4c0b1f9e2bfb40e2b57810535f529d91, State: Running, Role: LEADER
I20260807 19:56:00.588927 17387 consensus_queue.cc:237] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } }
I20260807 19:56:00.591416 16550 catalog_manager.cc:5495] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c0b1f9e2bfb40e2b57810535f529d91" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 42285 } health_report { overall_health: HEALTHY } } }
I20260807 19:56:00.634321 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:00.628721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55834 (local address 127.5.197.129:42285)
0807 19:56:00.629229 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:00.629234 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:00.629247 (+ 13us) server_negotiation.cc:407] Connection header received
0807 19:56:00.629295 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:00.629299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:00.629357 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:00.629443 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:56:00.629891 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.630663 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.632566 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.632994 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.633084 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:00.633536 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:56:00.633678 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:56:00.633788 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:00.633946 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 19:56:00.634009 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":218,"threads_started":1}
I20260807 19:56:00.643067 17194 raft_consensus.cc:1261] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Refusing update from remote peer 4c0b1f9e2bfb40e2b57810535f529d91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:56:00.643287 16984 raft_consensus.cc:1261] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Refusing update from remote peer 4c0b1f9e2bfb40e2b57810535f529d91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:56:00.643950 17387 consensus_queue.cc:1035] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb7afe675c0c43c7aa09a0ff39f35588" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:56:00.644250 17476 consensus_queue.cc:1035] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a50dd5fc7dc345e0b0a7eea83eba1ec3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:56:00.698221 16552 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:56:00.698470 16552 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:56:00.701548 16552 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea61888f2cca4e9b850618618d98a7f5: Sending DeleteTablet for 3 replicas of tablet 07ebf7bbb9c445e48e46efda834ce84f
I20260807 19:56:00.702447 16762 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ebf7bbb9c445e48e46efda834ce84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:00 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:55812
I20260807 19:56:00.702479 16955 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ebf7bbb9c445e48e46efda834ce84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:00 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:42972
I20260807 19:56:00.702440 17161 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ebf7bbb9c445e48e46efda834ce84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:00 UTC) from {username='oryx', principal='oryx/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:53012
I20260807 19:56:00.702761 17420 tablet_replica.cc:330] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: stopping tablet replica
I20260807 19:56:00.702785 17419 tablet_replica.cc:330] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: stopping tablet replica
I20260807 19:56:00.702796 17421 tablet_replica.cc:330] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: stopping tablet replica
I20260807 19:56:00.702942 17420 raft_consensus.cc:2229] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:56:00.702967 17419 raft_consensus.cc:2229] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:56:00.702966 17421 raft_consensus.cc:2229] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:56:00.703177 17421 raft_consensus.cc:2258] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:00.703177 17419 raft_consensus.cc:2258] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:00.703293 17420 raft_consensus.cc:2258] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:00.703989 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 16655
I20260807 19:56:00.704375 17419 ts_tablet_manager.cc:1905] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:00.704375 17421 ts_tablet_manager.cc:1905] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:00.704506 17420 ts_tablet_manager.cc:1905] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:00.711268 17419 ts_tablet_manager.cc:1918] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:56:00.711268 17421 ts_tablet_manager.cc:1918] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:56:00.711442 17419 log.cc:1196] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/07ebf7bbb9c445e48e46efda834ce84f
I20260807 19:56:00.711478 17421 log.cc:1196] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/07ebf7bbb9c445e48e46efda834ce84f
I20260807 19:56:00.711800 17420 ts_tablet_manager.cc:1918] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:56:00.711962 17420 log.cc:1196] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/07ebf7bbb9c445e48e46efda834ce84f
I20260807 19:56:00.712030 17421 ts_tablet_manager.cc:1939] T 07ebf7bbb9c445e48e46efda834ce84f P eb7afe675c0c43c7aa09a0ff39f35588: Deleting consensus metadata
I20260807 19:56:00.712154 17419 ts_tablet_manager.cc:1939] T 07ebf7bbb9c445e48e46efda834ce84f P a50dd5fc7dc345e0b0a7eea83eba1ec3: Deleting consensus metadata
I20260807 19:56:00.712409 17420 ts_tablet_manager.cc:1939] T 07ebf7bbb9c445e48e46efda834ce84f P 4c0b1f9e2bfb40e2b57810535f529d91: Deleting consensus metadata
I20260807 19:56:00.713297 16527 catalog_manager.cc:4841] TS a50dd5fc7dc345e0b0a7eea83eba1ec3 (127.5.197.131:45735): tablet 07ebf7bbb9c445e48e46efda834ce84f (table test-table [id=2d4cb44d4f1242879014e39f25e3d58c]) successfully deleted
I20260807 19:56:00.713302 16529 catalog_manager.cc:4841] TS eb7afe675c0c43c7aa09a0ff39f35588 (127.5.197.130:45751): tablet 07ebf7bbb9c445e48e46efda834ce84f (table test-table [id=2d4cb44d4f1242879014e39f25e3d58c]) successfully deleted
I20260807 19:56:00.713693 16529 catalog_manager.cc:4841] TS 4c0b1f9e2bfb40e2b57810535f529d91 (127.5.197.129:42285): tablet 07ebf7bbb9c445e48e46efda834ce84f (table test-table [id=2d4cb44d4f1242879014e39f25e3d58c]) successfully deleted
Aug 07 19:56:00 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.129@KRBTEST.COM
I20260807 19:56:00.727557 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:00.707172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55844 (local address 127.5.197.129:42285)
0807 19:56:00.707356 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:00.707362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:00.713976 (+ 6614us) server_negotiation.cc:407] Connection header received
0807 19:56:00.714116 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:00.714119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:00.714208 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:00.714300 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:00.715475 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.716256 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.717423 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.717849 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.717955 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:00.721927 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:00.721951 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:00.721974 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:00.722021 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:00.725012 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:00.725762 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:00.725770 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:00.725772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:00.725901 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:00.726186 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:00.726189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:00.726191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:00.726529 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:00.726802 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:00.727078 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 19:56:00.727291 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 19:56:00.728407 16845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:00.857724 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 16655
I20260807 19:56:00.897284 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 16855
Aug 07 19:56:00 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.130@KRBTEST.COM
I20260807 19:56:00.913599 17492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:00.898068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43012 (local address 127.5.197.130:45751)
0807 19:56:00.898597 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:00.898602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:00.898619 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:56:00.898680 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:00.898684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:00.898763 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:00.898855 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:00.900213 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.901014 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.902445 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:00.902908 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:00.903014 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:00.907462 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:00.907482 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:00.907501 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:00.907547 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:00.910607 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:00.911418 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:00.911427 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:00.911430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:00.911589 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:00.912061 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:00.912065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:00.912067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:00.912514 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:00.912783 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:00.913057 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 19:56:00.913299 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":249,"threads_started":1}
I20260807 19:56:00.914335 17048 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:01.063766 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 16855
I20260807 19:56:01.102484 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 17059
Aug 07 19:56:01 dist-test-slave-6bbx krb5kdc[16485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.197.131@KRBTEST.COM
I20260807 19:56:01.118104 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:01.103307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.5.197.131:45735)
0807 19:56:01.103864 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:01.103870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:01.103889 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:56:01.103947 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:01.103951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:01.104013 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:01.104135 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:01.105523 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:01.106265 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:01.107630 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:01.108102 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:01.108256 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:01.112671 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:01.112692 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:01.112716 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:01.112768 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:01.115496 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:01.116318 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:01.116326 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:01.116328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:01.116458 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:01.116750 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:01.116753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:01.116755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:01.117115 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:01.117397 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:01.117649 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 19:56:01.117830 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":267,"threads_started":1}
I20260807 19:56:01.118836 17270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:01.217818 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 17059
I20260807 19:56:01.245265 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 16501
I20260807 19:56:01.246598 16608 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:01.367439 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 16501
2026-08-07T19:56:01Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7464 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:56:01 dist-test-slave-6bbx krb5kdc[17504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:56:01 dist-test-slave-6bbx krb5kdc[17504](info): set up 2 sockets
Aug 07 19:56:01 dist-test-slave-6bbx krb5kdc[17504](info): commencing operation
krb5kdc: starting...
W20260807 19:56:02.586205 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.001s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:56:02 dist-test-slave-6bbx krb5kdc[17504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:56:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:56:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:56:02.888700 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37065
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:03.239202 17522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:03.239533 17522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:03.239657 17522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:03.247149 17522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:56:03.247278 17522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:03.247344 17522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:03.247424 17522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:56:03.247483 17522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:56:03.257875 17522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:03.259279 17522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:03.260718 17522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:03.273087 17532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:03.273102 17533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:03.273180 17536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:03.273741 17522 server_base.cc:1034] running on GCE node
I20260807 19:56:03.274663 17522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:03.276257 17522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:03.277465 17522 hybrid_clock.cc:648] HybridClock initialized: now 1786132563277403 us; error 46 us; skew 500 ppm
I20260807 19:56:03.277837 17522 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T19:56:03Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1967 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:56:03 dist-test-slave-6bbx krb5kdc[17548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:56:03 dist-test-slave-6bbx krb5kdc[17548](info): set up 2 sockets
Aug 07 19:56:03 dist-test-slave-6bbx krb5kdc[17548](info): commencing operation
krb5kdc: starting...
W20260807 19:56:04.560233 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.006s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:56:04 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:56:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:56:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:56:04.866801 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:38125
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:38125
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:05.232692 17562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:05.233047 17562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:05.233196 17562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:05.240878 17562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:56:05.241025 17562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:05.241114 17562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:05.241194 17562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:56:05.241254 17562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:56:05.252266 17562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:38125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:38125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:05.253747 17562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:05.255223 17562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:05.267638 17568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:05.267709 17570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:05.267736 17567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:05.268772 17562 server_base.cc:1034] running on GCE node
I20260807 19:56:05.269663 17562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:05.271199 17562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:05.272409 17562 hybrid_clock.cc:648] HybridClock initialized: now 1786132565272353 us; error 43 us; skew 500 ppm
I20260807 19:56:05.272761 17562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:05 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132565, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:05.280447 17562 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:56:05.282125 17562 webserver.cc:460] Webserver started at http://127.5.197.190:45451/ using document root <none> and password file <none>
I20260807 19:56:05.282894 17562 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:05.283020 17562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:05.283344 17562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:05.286593 17562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "75af4a14c23b43d08ba89ab47c06ebd8"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "18a7c2652601fee7196241bd6c79d444"
server_key_iv: "188c8691cd48813838ab1241763bf206"
server_key_version: "encryptionkey@0"
I20260807 19:56:05.287422 17562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "75af4a14c23b43d08ba89ab47c06ebd8"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "18a7c2652601fee7196241bd6c79d444"
server_key_iv: "188c8691cd48813838ab1241763bf206"
server_key_version: "encryptionkey@0"
I20260807 19:56:05.292878 17562 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 19:56:05.296396 17581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:05.297725 17562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:56:05.297900 17562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "75af4a14c23b43d08ba89ab47c06ebd8"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "18a7c2652601fee7196241bd6c79d444"
server_key_iv: "188c8691cd48813838ab1241763bf206"
server_key_version: "encryptionkey@0"
I20260807 19:56:05.298105 17562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:05.317775 17562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:05.322078 17562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:05.322376 17562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:05.340917 17562 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:38125
I20260807 19:56:05.340947 17665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:38125 every 8 connection(s)
I20260807 19:56:05.342463 17562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:56:05.346516 17666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:05.348461 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 17562
I20260807 19:56:05.348685 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:56:05.349362 5910 external_mini_cluster.cc:1428] Setting key 328de84f0c2bd4cd33486b974653fe6e
I20260807 19:56:05.360124 17666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Bootstrap starting.
I20260807 19:56:05.363848 17666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Neither blocks nor log segments found. Creating new log.
Aug 07 19:56:05 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:05.364893 17666 log.cc:824] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:05.368376 17666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: No bootstrap required, opened a new log
I20260807 19:56:05.374140 17669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:05.351463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46740 (local address 127.5.197.190:38125)
0807 19:56:05.352374 (+ 911us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:05.352390 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:05.352441 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:56:05.354846 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:05.354875 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:05.355388 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:05.355857 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:05.357123 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:05.359164 (+ 2041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:05.360536 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:05.361544 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:05.361731 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:05.365588 (+ 3857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:05.365597 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:05.365612 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:05.365658 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:05.369551 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:05.370242 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:05.370250 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:05.370259 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:05.370488 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:05.370830 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:05.370836 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:05.370839 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:05.371616 (+ 777us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:05.371975 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:05.372277 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 19:56:05.372747 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":342,"threads_started":1}
I20260807 19:56:05.378468 17666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:05.378821 17666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:05.378901 17666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75af4a14c23b43d08ba89ab47c06ebd8, State: Initialized, Role: FOLLOWER
I20260807 19:56:05.379447 17666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:05.379714 17666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:56:05.379838 17666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:56:05.379968 17666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:05.382207 17666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:05.382819 17666 leader_election.cc:302] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75af4a14c23b43d08ba89ab47c06ebd8; no voters:
I20260807 19:56:05.383400 17666 leader_election.cc:288] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:56:05.383527 17671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:56:05.384214 17671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 LEADER]: Becoming Leader. State: Replica: 75af4a14c23b43d08ba89ab47c06ebd8, State: Running, Role: LEADER
I20260807 19:56:05.384759 17671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:05.385454 17666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:56:05.387799 17672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } } }
I20260807 19:56:05.388082 17672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:05.387452 17673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75af4a14c23b43d08ba89ab47c06ebd8. Latest consensus state: current_term: 1 leader_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } } }
I20260807 19:56:05.388602 17673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:05.389902 17679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:56:05.395015 17679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:56:05.405426 17679 catalog_manager.cc:1347] Generated new cluster ID: a699eb80a4c94b9fa25ebbcc092c8cab
I20260807 19:56:05.405555 17679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:56:05.438704 17679 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:56:05.440738 17679 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:56:05.450562 17679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Generated new TSK 0
I20260807 19:56:05.451710 17679 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:56:05.525228 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:38125
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:05.881052 17705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:05.881356 17705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:05.881480 17705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:05.889021 17705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:05.889170 17705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:05.889361 17705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:56:05.899398 17705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:38125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:05.900753 17705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:05.902201 17705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:05.915613 17717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:05.915692 17719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:05.915705 17721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:05.916486 17705 server_base.cc:1034] running on GCE node
I20260807 19:56:05.917074 17705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:05.918023 17705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:05.919229 17705 hybrid_clock.cc:648] HybridClock initialized: now 1786132565919170 us; error 49 us; skew 500 ppm
I20260807 19:56:05.919538 17705 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:05 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132565, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:05.922739 17705 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:56:05.924229 17705 webserver.cc:460] Webserver started at http://127.5.197.129:39621/ using document root <none> and password file <none>
I20260807 19:56:05.924902 17705 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:05.925022 17705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:05.925346 17705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:05.928301 17705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "8512e0af81b3469a805c72b8ba3a1011"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "7c63477c3d546203561cff520c8737e5"
server_key_iv: "309da52ebb3fb6dafdcee805c1cd482f"
server_key_version: "encryptionkey@0"
I20260807 19:56:05.929072 17705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "8512e0af81b3469a805c72b8ba3a1011"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "7c63477c3d546203561cff520c8737e5"
server_key_iv: "309da52ebb3fb6dafdcee805c1cd482f"
server_key_version: "encryptionkey@0"
I20260807 19:56:05.934074 17705 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:56:05.937496 17731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:05.938732 17705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:56:05.938896 17705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "8512e0af81b3469a805c72b8ba3a1011"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "7c63477c3d546203561cff520c8737e5"
server_key_iv: "309da52ebb3fb6dafdcee805c1cd482f"
server_key_version: "encryptionkey@0"
I20260807 19:56:05.939077 17705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:05.960979 17705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:05.965265 17705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:05.965549 17705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:05.966522 17705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:05.967906 17705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:05.967991 17705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:05.968122 17705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:05.968178 17705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:05.999037 17705 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:41579
I20260807 19:56:05.999083 17886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:41579 every 8 connection(s)
I20260807 19:56:06.000312 17705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:56:06.005017 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 17705
I20260807 19:56:06.005208 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:56:06.005844 5910 external_mini_cluster.cc:1428] Setting key 56496d56177e48297c36d57826ad1dcf
Aug 07 19:56:06 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132565, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:06.019614 17891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:06.002946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:55583 (local address 127.5.197.190:38125)
0807 19:56:06.003425 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:06.003430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:06.004242 (+ 812us) server_negotiation.cc:407] Connection header received
0807 19:56:06.006171 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:06.006177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:06.006257 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:06.006350 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:06.008050 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.008773 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.010290 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.010702 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.010815 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:06.014190 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:06.014195 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:06.014198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:06.014229 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:06.016690 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:06.017385 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:06.017389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:06.017391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:06.017513 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:06.017918 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:06.017922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:06.017924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:06.018176 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:06.018339 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:06.018994 (+ 655us) server_negotiation.cc:299] Negotiation successful
0807 19:56:06.019221 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":243,"threads_started":1}
I20260807 19:56:06.020542 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:06.003353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:55583)
0807 19:56:06.004083 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:06.004128 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:06.005886 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:06.006611 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:06.006622 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:06.007198 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:06.007886 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:06.007912 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.008928 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.008932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:06.010151 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:06.010163 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.010932 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.010941 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:06.011156 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:06.011793 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:06.011816 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:06.013967 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:06.016820 (+ 2853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:06.016829 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:06.016844 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:06.017257 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:06.017616 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:06.017621 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:06.017625 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:06.017804 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:06.018303 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:06.018311 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:06.018633 (+ 322us) client_negotiation.cc:769] Sending connection context
0807 19:56:06.018869 (+ 236us) client_negotiation.cc:240] Negotiation successful
0807 19:56:06.019380 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":288,"threads_started":1}
I20260807 19:56:06.022013 17887 heartbeater.cc:347] Connected to a master server at 127.5.197.190:38125
I20260807 19:56:06.022303 17887 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:06.022992 17887 heartbeater.cc:511] Master 127.5.197.190:38125 requested a full tablet report, sending...
I20260807 19:56:06.025326 17608 ts_manager.cc:194] Registered new tserver with Master: 8512e0af81b3469a805c72b8ba3a1011 (127.5.197.129:41579)
I20260807 19:56:06.027231 17608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:55583
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:56:06.064694 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:38125
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:06.406601 17897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:06.406909 17897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:06.407017 17897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:06.414448 17897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:06.414573 17897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:06.414696 17897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:56:06.424865 17897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:38125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:06.426210 17897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:06.427524 17897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:06.441038 17906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:06.441092 17910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:06.441118 17907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:06.441629 17897 server_base.cc:1034] running on GCE node
I20260807 19:56:06.442274 17897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:06.443297 17897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:06.444512 17897 hybrid_clock.cc:648] HybridClock initialized: now 1786132566444425 us; error 73 us; skew 500 ppm
I20260807 19:56:06.444821 17897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:06 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132566, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:06.447947 17897 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:56:06.449460 17897 webserver.cc:460] Webserver started at http://127.5.197.130:46855/ using document root <none> and password file <none>
I20260807 19:56:06.450145 17897 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:06.450268 17897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:06.450580 17897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:06.453748 17897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "5fcdd006fad04903a17df761ba915c8c"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "b91f3eb538a7a65a361e0a4c936e37aa"
server_key_iv: "4ce70363c283ed12d3cfb2669eb35496"
server_key_version: "encryptionkey@0"
I20260807 19:56:06.454500 17897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "5fcdd006fad04903a17df761ba915c8c"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "b91f3eb538a7a65a361e0a4c936e37aa"
server_key_iv: "4ce70363c283ed12d3cfb2669eb35496"
server_key_version: "encryptionkey@0"
I20260807 19:56:06.459762 17897 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 19:56:06.463286 17922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:06.464741 17897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:56:06.464902 17897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "5fcdd006fad04903a17df761ba915c8c"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "b91f3eb538a7a65a361e0a4c936e37aa"
server_key_iv: "4ce70363c283ed12d3cfb2669eb35496"
server_key_version: "encryptionkey@0"
I20260807 19:56:06.465099 17897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:06.478901 17897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:06.482852 17897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:06.483131 17897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:06.484130 17897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:06.485488 17897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:06.485562 17897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:06.485680 17897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:06.485735 17897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:06.517393 17897 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:45439
I20260807 19:56:06.517443 18075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:45439 every 8 connection(s)
I20260807 19:56:06.518730 17897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:56:06.521050 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 17897
I20260807 19:56:06.521251 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:56:06.521700 5910 external_mini_cluster.cc:1428] Setting key 9335149f128d8c701c342066b9441d80
Aug 07 19:56:06 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132566, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:06.538921 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:06.521753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:33381 (local address 127.5.197.190:38125)
0807 19:56:06.522294 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:06.522300 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:06.523371 (+ 1071us) server_negotiation.cc:407] Connection header received
0807 19:56:06.525315 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:06.525321 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:06.525405 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:06.525499 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:06.527010 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.527774 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.529309 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.529761 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.529887 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:06.533207 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:06.533212 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:06.533215 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:06.533248 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:06.535942 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:06.536650 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:06.536655 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:06.536659 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:06.536796 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:06.537175 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:06.537179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:06.537182 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:06.537522 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:06.537660 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:06.538312 (+ 652us) server_negotiation.cc:299] Negotiation successful
0807 19:56:06.538570 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":246,"threads_started":1}
I20260807 19:56:06.539770 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:06.522019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:33381)
0807 19:56:06.523196 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:06.523246 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:06.525036 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:06.525754 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:06.525763 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:06.526265 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:06.526838 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:06.526856 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.527935 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.527939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:06.529167 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:06.529180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:06.529985 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:06.529992 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:06.530216 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:06.530848 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:06.530873 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:06.532991 (+ 2118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:06.536083 (+ 3092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:06.536090 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:06.536104 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:06.536532 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:06.536881 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:06.536884 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:06.536887 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:06.537072 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:06.537631 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:06.537637 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:06.537955 (+ 318us) client_negotiation.cc:769] Sending connection context
0807 19:56:06.538179 (+ 224us) client_negotiation.cc:240] Negotiation successful
0807 19:56:06.538598 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"thread_start_us":658,"threads_started":1}
I20260807 19:56:06.541304 18077 heartbeater.cc:347] Connected to a master server at 127.5.197.190:38125
I20260807 19:56:06.541656 18077 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:06.542611 18077 heartbeater.cc:511] Master 127.5.197.190:38125 requested a full tablet report, sending...
I20260807 19:56:06.544277 17608 ts_manager.cc:194] Registered new tserver with Master: 5fcdd006fad04903a17df761ba915c8c (127.5.197.130:45439)
I20260807 19:56:06.545114 17608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:33381
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:56:06.586792 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:38125
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:06.932569 18083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:06.932873 18083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:06.932982 18083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:06.940184 18083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:06.940307 18083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:06.940439 18083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:56:06.950304 18083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:38125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:06.951627 18083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:06.952960 18083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:06.966122 18093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:06.966225 18098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:06.966280 18095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:06.967199 18083 server_base.cc:1034] running on GCE node
I20260807 19:56:06.967851 18083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:06.968883 18083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:06.970072 18083 hybrid_clock.cc:648] HybridClock initialized: now 1786132566970018 us; error 41 us; skew 500 ppm
I20260807 19:56:06.970382 18083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:06 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132566, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:06.973414 18083 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:56:06.974928 18083 webserver.cc:460] Webserver started at http://127.5.197.131:37203/ using document root <none> and password file <none>
I20260807 19:56:06.975612 18083 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:06.975760 18083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:06.976058 18083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:06.978935 18083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "5d5c8a84727d4770bfa3440a7cd0c24b"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "7e55073d4dac9d12775fd1609e8e5293"
server_key_iv: "a0be3495d55caea347d1987a0767c21f"
server_key_version: "encryptionkey@0"
I20260807 19:56:06.979749 18083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "5d5c8a84727d4770bfa3440a7cd0c24b"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "7e55073d4dac9d12775fd1609e8e5293"
server_key_iv: "a0be3495d55caea347d1987a0767c21f"
server_key_version: "encryptionkey@0"
I20260807 19:56:06.984871 18083 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260807 19:56:06.988442 18109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:06.989760 18083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:56:06.989916 18083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "5d5c8a84727d4770bfa3440a7cd0c24b"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "7e55073d4dac9d12775fd1609e8e5293"
server_key_iv: "a0be3495d55caea347d1987a0767c21f"
server_key_version: "encryptionkey@0"
I20260807 19:56:06.990101 18083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:07.005822 18083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:07.010026 18083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:07.010317 18083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:07.011302 18083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:07.012678 18083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:07.012768 18083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:07.012907 18083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:07.012962 18083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:07.030079 17887 heartbeater.cc:503] Master 127.5.197.190:38125 was elected leader, sending a full tablet report...
I20260807 19:56:07.044373 18083 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:35691
I20260807 19:56:07.044413 18280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:35691 every 8 connection(s)
I20260807 19:56:07.045660 18083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:56:07.046257 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 18083
I20260807 19:56:07.046473 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:56:07.047015 5910 external_mini_cluster.cc:1428] Setting key 547f2d176786b7385d75fb4ab4a478b9
Aug 07 19:56:07 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132566, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:07.065712 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:07.048249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:57051 (local address 127.5.197.190:38125)
0807 19:56:07.048702 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:07.048707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:07.049955 (+ 1248us) server_negotiation.cc:407] Connection header received
0807 19:56:07.051973 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:07.051977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:07.052055 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:07.052141 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:07.053557 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.054334 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.055903 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.056332 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.056439 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:07.059905 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:07.059911 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:07.059914 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:07.059964 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:07.062600 (+ 2636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.063323 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.063327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.063329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.063455 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.063936 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.063939 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.063941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.064209 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:07.064353 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:07.065052 (+ 699us) server_negotiation.cc:299] Negotiation successful
0807 19:56:07.065300 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":213,"threads_started":1}
I20260807 19:56:07.066663 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:07.048903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:57051)
0807 19:56:07.049778 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:07.049827 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:07.051739 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:07.052338 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:07.052346 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:07.052861 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:07.053425 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:07.053443 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.054467 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.054471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:07.055752 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:07.055765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.056535 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.056540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:07.056762 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:07.057409 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:07.057434 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:07.059636 (+ 2202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:07.062743 (+ 3107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:07.062753 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:07.062770 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:07.063197 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:07.063559 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:07.063564 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:07.063568 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:07.063821 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:07.064335 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:07.064343 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:07.064697 (+ 354us) client_negotiation.cc:769] Sending connection context
0807 19:56:07.064937 (+ 240us) client_negotiation.cc:240] Negotiation successful
0807 19:56:07.065483 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":326,"threads_started":1}
I20260807 19:56:07.068080 18282 heartbeater.cc:347] Connected to a master server at 127.5.197.190:38125
I20260807 19:56:07.068406 18282 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:07.069139 18282 heartbeater.cc:511] Master 127.5.197.190:38125 requested a full tablet report, sending...
I20260807 19:56:07.070552 17608 ts_manager.cc:194] Registered new tserver with Master: 5d5c8a84727d4770bfa3440a7cd0c24b (127.5.197.131:35691)
I20260807 19:56:07.071347 17608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:57051
I20260807 19:56:07.075342 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab.
Entry for principal oryx/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab.
WARNING: no policy specified for oryx/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab.
Entry for principal oryx/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab.
WARNING: no policy specified for oryx/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab.
Entry for principal oryx/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab.
I20260807 19:56:07.251981 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 17705
Aug 07 19:56:07 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:56:07.267897 18296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:07.253203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56962 (local address 127.5.197.129:41579)
0807 19:56:07.253843 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:07.253851 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:07.253891 (+ 40us) server_negotiation.cc:407] Connection header received
0807 19:56:07.253957 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:07.253964 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:07.254181 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:07.254330 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:07.255644 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.256722 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.257920 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.258482 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.258577 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:07.262495 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:07.262507 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:07.262522 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:07.262556 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:07.265331 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.266086 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.266094 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.266096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.266224 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.266530 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.266532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.266534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.266873 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:07.267103 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:07.267290 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 19:56:07.267487 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":317,"threads_started":1}
I20260807 19:56:07.269210 17882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:07.357345 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 17705
I20260807 19:56:07.381242 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 17897
Aug 07 19:56:07 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:56:07.397857 18298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:07.382214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54210 (local address 127.5.197.130:45439)
0807 19:56:07.382822 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:07.382829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:07.382861 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:56:07.382930 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:07.382936 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:07.383158 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:07.383290 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:07.384676 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.385813 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.387121 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.387839 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.387950 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:07.392088 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:07.392100 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:07.392114 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:07.392150 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:07.395176 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.395941 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.395951 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.395954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.396102 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.396436 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.396439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.396441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.396800 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:07.397072 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:07.397344 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 19:56:07.397555 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":291,"threads_started":1}
I20260807 19:56:07.399230 18070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:07.482931 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 17897
I20260807 19:56:07.510437 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18083
Aug 07 19:56:07 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:56:07.527333 18300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:07.511478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43086 (local address 127.5.197.131:35691)
0807 19:56:07.512031 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:07.512038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:07.512069 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:56:07.512133 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:07.512139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:07.512364 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:07.512526 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:07.513911 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.514941 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.516316 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:07.516895 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:07.517023 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:07.521585 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:07.521598 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:07.521615 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:07.521653 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:07.524476 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.525147 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.525154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.525157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.525284 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:07.525671 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:07.525675 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:07.525677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:07.526074 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:07.526362 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:07.526692 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 19:56:07.526979 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":261,"threads_started":1}
I20260807 19:56:07.528743 18273 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:07.613274 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 18083
I20260807 19:56:07.635766 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 17562
I20260807 19:56:07.637018 17659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:07.742424 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 17562
I20260807 19:56:07.770467 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:38125
--webserver_interface=127.5.197.190
--webserver_port=45451
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:38125
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:08.129684 18306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:08.129982 18306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:08.130115 18306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:08.137384 18306 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:56:08.137506 18306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:08.137588 18306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:08.137663 18306 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:56:08.137722 18306 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:56:08.147923 18306 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:38125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:38125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=45451
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:08.149396 18306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:08.150769 18306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:08.162756 18314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:08.162786 18319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:08.163302 18321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:08.163723 18306 server_base.cc:1034] running on GCE node
I20260807 19:56:08.164572 18306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:08.166203 18306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:08.167423 18306 hybrid_clock.cc:648] HybridClock initialized: now 1786132568167371 us; error 45 us; skew 500 ppm
I20260807 19:56:08.167853 18306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:08 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132568, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:08.170967 18306 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:56:08.172493 18306 webserver.cc:460] Webserver started at http://127.5.197.190:45451/ using document root <none> and password file <none>
I20260807 19:56:08.173205 18306 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:08.173349 18306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:08.178864 18306 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:56:08.181692 18329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:08.183010 18306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:56:08.183163 18306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "75af4a14c23b43d08ba89ab47c06ebd8"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "18a7c2652601fee7196241bd6c79d444"
server_key_iv: "188c8691cd48813838ab1241763bf206"
server_key_version: "encryptionkey@0"
I20260807 19:56:08.184227 18306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:08.218158 18306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:08.222788 18306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:08.223064 18306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:08.241243 18306 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:38125
I20260807 19:56:08.241251 18406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:38125 every 8 connection(s)
I20260807 19:56:08.242851 18306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:56:08.249902 18407 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:56:08.251214 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 18306
I20260807 19:56:08.252233 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:41579
--local_ip_for_outbound_sockets=127.5.197.129
--tserver_master_addrs=127.5.197.190:38125
--webserver_port=39621
--webserver_interface=127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:56:08.254215 18407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Bootstrap starting.
I20260807 19:56:08.275660 18407 log.cc:824] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:08.284651 18407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:56:08.285151 18407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Bootstrap complete.
I20260807 19:56:08.294480 18407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:08.295343 18407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75af4a14c23b43d08ba89ab47c06ebd8, State: Initialized, Role: FOLLOWER
I20260807 19:56:08.295971 18407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:08.296208 18407 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:56:08.296319 18407 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:56:08.296492 18407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:56:08.300312 18407 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:08.300781 18407 leader_election.cc:302] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75af4a14c23b43d08ba89ab47c06ebd8; no voters:
I20260807 19:56:08.301416 18407 leader_election.cc:288] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:56:08.301578 18416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:56:08.302740 18416 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [term 2 LEADER]: Becoming Leader. State: Replica: 75af4a14c23b43d08ba89ab47c06ebd8, State: Running, Role: LEADER
I20260807 19:56:08.303370 18416 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } }
I20260807 19:56:08.303606 18407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:56:08.306166 18420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75af4a14c23b43d08ba89ab47c06ebd8. Latest consensus state: current_term: 2 leader_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } } }
I20260807 19:56:08.306524 18420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:08.307024 18418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75af4a14c23b43d08ba89ab47c06ebd8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38125 } } }
I20260807 19:56:08.307583 18418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8 [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:08.309430 18425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:56:08.319478 18425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:56:08.321606 18425 catalog_manager.cc:1259] Loaded cluster ID: a699eb80a4c94b9fa25ebbcc092c8cab
I20260807 19:56:08.323222 18425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:56:08.327436 18425 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:56:08.329074 18425 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75af4a14c23b43d08ba89ab47c06ebd8: Loaded TSK: 0
I20260807 19:56:08.330695 18425 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 19:56:08.605634 18413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:08.605916 18413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:08.606032 18413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:08.614300 18413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:08.614403 18413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:08.614559 18413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:56:08.624279 18413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.129.keytab
--principal=oryx/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:41579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=39621
--tserver_master_addrs=127.5.197.190:38125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:08.625545 18413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:08.626829 18413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:08.640161 18444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:08.640192 18445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:08.640725 18447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:08.641343 18413 server_base.cc:1034] running on GCE node
I20260807 19:56:08.642055 18413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:08.643132 18413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:08.644354 18413 hybrid_clock.cc:648] HybridClock initialized: now 1786132568644280 us; error 57 us; skew 500 ppm
I20260807 19:56:08.644721 18413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:08 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132568, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:08.648298 18413 init.cc:377] Logged in from keytab as oryx/127.5.197.129@KRBTEST.COM (short username oryx)
I20260807 19:56:08.649760 18413 webserver.cc:460] Webserver started at http://127.5.197.129:39621/ using document root <none> and password file <none>
I20260807 19:56:08.650429 18413 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:08.650586 18413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:08.656273 18413 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:56:08.658869 18454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:08.660166 18413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 19:56:08.660334 18413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "8512e0af81b3469a805c72b8ba3a1011"
format_stamp: "Formatted at 2026-08-07 19:56:05 on dist-test-slave-6bbx"
server_key: "7c63477c3d546203561cff520c8737e5"
server_key_iv: "309da52ebb3fb6dafdcee805c1cd482f"
server_key_version: "encryptionkey@0"
I20260807 19:56:08.661437 18413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:08.684553 18413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:08.688724 18413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:08.688944 18413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:08.689870 18413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:08.691227 18413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:08.691326 18413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:08.691404 18413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:08.691459 18413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:08.722196 18413 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:41579
I20260807 19:56:08.722273 18623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:41579 every 8 connection(s)
I20260807 19:56:08.723611 18413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:56:08.732184 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 18413
I20260807 19:56:08.732758 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:45439
--local_ip_for_outbound_sockets=127.5.197.130
--tserver_master_addrs=127.5.197.190:38125
--webserver_port=46855
--webserver_interface=127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:56:08 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:08 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:56:09.088600 18630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:09.088939 18630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:09.089080 18630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:09.096693 18630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:09.096822 18630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:09.096994 18630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:56:09.107266 18630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.130.keytab
--principal=oryx/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:45439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=46855
--tserver_master_addrs=127.5.197.190:38125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:09.108788 18630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:09.110157 18630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:09.126938 18640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:09.127326 18639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:09.127578 18643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:09.128299 18630 server_base.cc:1034] running on GCE node
I20260807 19:56:09.129302 18630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:09.130831 18630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:09.132090 18630 hybrid_clock.cc:648] HybridClock initialized: now 1786132569131987 us; error 85 us; skew 500 ppm
I20260807 19:56:09.132565 18630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132569, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:09.137477 18630 init.cc:377] Logged in from keytab as oryx/127.5.197.130@KRBTEST.COM (short username oryx)
I20260807 19:56:09.139832 18630 webserver.cc:460] Webserver started at http://127.5.197.130:46855/ using document root <none> and password file <none>
I20260807 19:56:09.141016 18630 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:09.141216 18630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:09.150204 18630 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:56:09.154507 18651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:09.156159 18630 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:56:09.156335 18630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "5fcdd006fad04903a17df761ba915c8c"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "b91f3eb538a7a65a361e0a4c936e37aa"
server_key_iv: "4ce70363c283ed12d3cfb2669eb35496"
server_key_version: "encryptionkey@0"
I20260807 19:56:09.157370 18630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:09.181284 18630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:09.185740 18630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:09.186004 18630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:09.187103 18630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:09.188725 18630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:09.188830 18630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:09.188951 18630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:09.189023 18630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:09.228489 18630 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:45439
I20260807 19:56:09.228540 18842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:45439 every 8 connection(s)
I20260807 19:56:09.230175 18630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:56:09.237030 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 18630
I20260807 19:56:09.237901 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:35691
--local_ip_for_outbound_sockets=127.5.197.131
--tserver_master_addrs=127.5.197.190:38125
--webserver_port=37203
--webserver_interface=127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:56:09.785969 18850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:09.786298 18850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:09.786473 18850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:09.794339 18850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:09.794481 18850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:09.794672 18850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:56:09.805303 18850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/krb5kdc/oryx_127.5.197.131.keytab
--principal=oryx/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:35691
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=37203
--tserver_master_addrs=127.5.197.190:38125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:09.806854 18850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:09.808388 18850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:09.825565 18858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:09.828099 18857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:09.829692 18862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:09.830320 18850 server_base.cc:1034] running on GCE node
I20260807 19:56:09.831133 18850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:09.832516 18850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:09.833854 18850 hybrid_clock.cc:648] HybridClock initialized: now 1786132569833776 us; error 76 us; skew 500 ppm
I20260807 19:56:09.834252 18850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132569, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:09.838471 18850 init.cc:377] Logged in from keytab as oryx/127.5.197.131@KRBTEST.COM (short username oryx)
I20260807 19:56:09.841482 18850 webserver.cc:460] Webserver started at http://127.5.197.131:37203/ using document root <none> and password file <none>
I20260807 19:56:09.842741 18850 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:09.842949 18850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:09.852273 18850 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.001s
W20260807 19:56:09.854143 18629 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.117s user 0.004s sys 0.011s
I20260807 19:56:09.856181 18629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:08.726493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:43857)
0807 19:56:08.727308 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:08.727354 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:08.729125 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:08.730501 (+ 1376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:08.730511 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:08.731096 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:08.731627 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:08.731652 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:08.733396 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:08.733402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:08.735156 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:08.735172 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:08.736181 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:08.736189 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:08.736446 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:08.737100 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:08.737128 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:09.854953 (+1117825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":312,"threads_started":1}
W20260807 19:56:09.857717 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:08.726461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:43857 (local address 127.5.197.190:38125)
0807 19:56:08.727217 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:08.727233 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:08.727485 (+ 252us) server_negotiation.cc:407] Connection header received
0807 19:56:08.729661 (+ 2176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:08.729673 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:08.730003 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:08.730314 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:08.731845 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:08.733228 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:08.735283 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:08.735966 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:08.736103 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.856750 (+1120647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:43857: BlockingRecv error: recv got EOF from 127.5.197.129:43857 (error 108)
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":259,"threads_started":1}
W20260807 19:56:09.857851 18625 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:38125 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.197.190:38125: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
I20260807 19:56:09.859871 18870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:09.862586 18850 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.006s sys 0.001s
I20260807 19:56:09.862782 18850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "5d5c8a84727d4770bfa3440a7cd0c24b"
format_stamp: "Formatted at 2026-08-07 19:56:06 on dist-test-slave-6bbx"
server_key: "7e55073d4dac9d12775fd1609e8e5293"
server_key_iv: "a0be3495d55caea347d1987a0767c21f"
server_key_version: "encryptionkey@0"
I20260807 19:56:09.863967 18850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:56:09.871470 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:09.858893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:57919 (local address 127.5.197.190:38125)
0807 19:56:09.859044 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:09.859049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:09.859070 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:56:09.859290 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:09.859296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:09.859381 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:09.859477 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:09.860658 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.861455 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.863613 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.864358 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.864490 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.871179 (+ 6689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:57919: BlockingRecv error: recv got EOF from 127.5.197.129:57919 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:56:09.872121 18629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:09.858702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:57919)
0807 19:56:09.858998 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:09.859017 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:09.859144 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:09.859603 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:09.859611 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:09.860188 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:09.860466 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.860481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.861625 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.861632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.863412 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.863433 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.864611 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.864620 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.864832 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.865590 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:09.865617 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:09.871850 (+ 6233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171}
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:09.885695 18880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:09.872844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:55919)
0807 19:56:09.873552 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:09.873575 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:09.873754 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:09.874126 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:09.874131 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:09.874824 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:09.875179 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.875194 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.876638 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.876645 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.878341 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.878368 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.879344 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.879359 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.879580 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.880374 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:09.880401 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:09.885342 (+ 4941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":256,"threads_started":1}
I20260807 19:56:09.885804 18850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
W20260807 19:56:09.886089 18625 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:56:09.886313 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:09.872986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:55919 (local address 127.5.197.190:38125)
0807 19:56:09.873186 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:09.873192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:09.873679 (+ 487us) server_negotiation.cc:407] Connection header received
0807 19:56:09.873882 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:09.873888 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:09.873978 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:09.874074 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:09.875354 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.876480 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.878506 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.879133 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.879254 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.885721 (+ 6467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:55919: BlockingRecv error: recv got EOF from 127.5.197.129:55919 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:56:09.890552 18850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:09.890822 18850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:09.891999 18850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:09.893613 18850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:09.893709 18850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:09.893817 18850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:09.893890 18850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:09.935329 18850 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:35691
I20260807 19:56:09.935364 19054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:35691 every 8 connection(s)
I20260807 19:56:09.936905 18850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:56:09.944480 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 18850
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:09 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:09.970726 19058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:09.945591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41984 (local address 127.5.197.190:38125)
0807 19:56:09.952471 (+ 6880us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:09.952476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:09.952496 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:56:09.952549 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:09.952554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:09.952626 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:09.952741 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:09.954995 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.956211 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.958233 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.958854 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.958977 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.962790 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:09.962801 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:09.962828 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:09.962883 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:09.966742 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:09.967711 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:09.967721 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:09.967730 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:09.967946 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:09.968431 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:09.968435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:09.968437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:09.968953 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:09.969272 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:09.969853 (+ 581us) server_negotiation.cc:299] Negotiation successful
0807 19:56:09.970345 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6752,"thread_start_us":6607,"threads_started":1}
W20260807 19:56:10.376528 18848 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.132s user 0.005s sys 0.012s
W20260807 19:56:10.378242 18846 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:09.233545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:58891 (local address 127.5.197.190:38125)
0807 19:56:09.234111 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:09.234120 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:09.235120 (+ 1000us) server_negotiation.cc:407] Connection header received
0807 19:56:09.237373 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:09.237379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:09.237451 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:09.237551 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:09.239300 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.240122 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.242625 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.243310 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.243443 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.377798 (+1134355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:58891: BlockingRecv error: recv got EOF from 127.5.197.130:58891 (error 108)
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":254,"threads_started":1}
I20260807 19:56:10.378504 18848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:09.234087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:58891)
0807 19:56:09.234933 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:09.234990 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:09.236962 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:09.237873 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:09.237882 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:09.238504 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:09.239108 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.239127 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.240293 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.240297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.242432 (+ 2135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.242450 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.243745 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.243754 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.244039 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.244887 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:09.244926 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:10.377486 (+1132560us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":332,"threads_started":1}
W20260807 19:56:10.379523 18843 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:38125 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.197.190:38125: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:10.392764 18848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:10.380395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:53987)
0807 19:56:10.380624 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:10.380646 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:10.380785 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:10.381110 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:10.381115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:10.381517 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:10.381691 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.381701 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.382819 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.382824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.383857 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.383871 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.384593 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.384600 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.384755 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.388107 (+ 3352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:10.388129 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:10.392532 (+ 4403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":79}
W20260807 19:56:10.393114 18846 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:10.380473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:53987 (local address 127.5.197.190:38125)
0807 19:56:10.380641 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:10.380647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:10.380718 (+ 71us) server_negotiation.cc:407] Connection header received
0807 19:56:10.380903 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:10.380908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:10.380973 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:10.381056 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:10.381852 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.382665 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.384002 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.384411 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.384525 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.392822 (+ 8297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:53987: BlockingRecv error: recv got EOF from 127.5.197.130:53987 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:10.404860 18848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:10.393981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:37269)
0807 19:56:10.394319 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:10.394341 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:10.394459 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:10.394847 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:10.394850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:10.395261 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:10.395497 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.395509 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.397173 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.397176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.398175 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.398190 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.399196 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.399201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.399341 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.400052 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:10.400070 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:10.404501 (+ 4431us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206}
W20260807 19:56:10.405016 18846 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:10.394131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:37269 (local address 127.5.197.190:38125)
0807 19:56:10.394342 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:10.394350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:10.394405 (+ 55us) server_negotiation.cc:407] Connection header received
0807 19:56:10.394587 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:10.394594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:10.394700 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:10.394818 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:10.395643 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.397012 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.398313 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.399046 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.399187 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.404731 (+ 5544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:37269: BlockingRecv error: recv got EOF from 127.5.197.130:37269 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 19:56:10.405332 18843 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:10.897750 19061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:10.887041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:60977)
0807 19:56:10.887647 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:10.887686 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:10.887849 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:10.888279 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:10.888285 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:10.888885 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:10.889085 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.889100 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.890705 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.890709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.891714 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.891732 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.892747 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.892752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.892881 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.893583 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:10.893601 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:10.897513 (+ 3912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":375,"threads_started":1}
W20260807 19:56:10.898172 18846 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:10.887168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:60977 (local address 127.5.197.190:38125)
0807 19:56:10.887406 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:10.887413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:10.887778 (+ 365us) server_negotiation.cc:407] Connection header received
0807 19:56:10.887979 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:10.887983 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:10.888121 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:10.888218 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:10.889259 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.890547 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.891859 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.892607 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.892746 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.897881 (+ 5135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:60977: BlockingRecv error: recv got EOF from 127.5.197.129:60977 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 19:56:10.990394 19057 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.038s user 0.002s sys 0.014s
W20260807 19:56:10.991513 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:09.939761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:37835 (local address 127.5.197.190:38125)
0807 19:56:09.939933 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:09.939938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:09.941587 (+ 1649us) server_negotiation.cc:407] Connection header received
0807 19:56:09.943508 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:09.943514 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:09.943599 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:09.943726 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:09.945415 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.946675 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.949500 (+ 2825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.950276 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.950395 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.991307 (+1040912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:37835: BlockingRecv error: recv got EOF from 127.5.197.131:37835 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 19:56:10.992146 19057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:09.940569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:37835)
0807 19:56:09.941410 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:09.941454 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:09.943209 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:09.943985 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:09.943994 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:09.944512 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:09.945170 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.945196 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.946935 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.946942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.949262 (+ 2320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:09.949283 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:09.950812 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:09.950820 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:09.951167 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:09.952476 (+ 1309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:09.952507 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:10.991122 (+1038615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":338,"threads_started":1}
W20260807 19:56:10.993024 19055 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:38125 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.197.190:38125: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:10 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:11.002878 19057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:10.993654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:59101)
0807 19:56:10.993844 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:10.993861 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:10.993958 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:10.994409 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:10.994413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:10.994769 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:10.994953 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.994962 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.996174 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.996187 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.997167 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:10.997190 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.997917 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.997921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:10.998043 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:10.998638 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:10.998657 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:11.002564 (+ 3907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 19:56:11.003027 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:10.993745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:59101 (local address 127.5.197.190:38125)
0807 19:56:10.993954 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:10.993959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:10.993977 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:56:10.994035 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:10.994039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:10.994099 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:10.994278 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:10.995101 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.996007 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.997308 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:10.997743 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:10.997844 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:11.002797 (+ 4953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:59101: BlockingRecv error: recv got EOF from 127.5.197.131:59101 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
Aug 07 19:56:11 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:11 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:11.011534 19057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:11.003796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:46475)
0807 19:56:11.003962 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:11.003978 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:11.004068 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:11.004350 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:11.004353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:11.004651 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:11.004853 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:11.004863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.005855 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.005859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:11.006823 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:11.006834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.007504 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.007508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:11.007636 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:11.008167 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:11.008183 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:11.011311 (+ 3128us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 19:56:11.011754 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:11.003817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:46475 (local address 127.5.197.190:38125)
0807 19:56:11.003963 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:11.003967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:11.004018 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:56:11.004140 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:11.004144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:11.004239 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:11.004318 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:11.004973 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.005739 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.006967 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.007389 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.007481 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:11.011525 (+ 4044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:46475: BlockingRecv error: recv got EOF from 127.5.197.131:46475 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 19:56:11.011974 19055 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 19:56:11 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:11 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:11.414409 19063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:11.405871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:46409)
0807 19:56:11.406378 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:11.406399 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:11.406519 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:11.406840 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:11.406844 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:11.407243 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:11.407403 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:11.407417 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.408628 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.408632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:11.409573 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:11.409586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.410238 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.410242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:11.410375 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:11.410893 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:11.410910 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:11.414152 (+ 3242us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":273,"threads_started":1}
W20260807 19:56:11.414611 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:11.405944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:46409 (local address 127.5.197.190:38125)
0807 19:56:11.406181 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:11.406187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:11.406477 (+ 290us) server_negotiation.cc:407] Connection header received
0807 19:56:11.406612 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:11.406615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:11.406695 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:11.406774 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:11.407559 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.408500 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.409708 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.410100 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.410203 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:11.414362 (+ 4159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:46409: BlockingRecv error: recv got EOF from 127.5.197.130:46409 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 07 19:56:11 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:11 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:11.908723 19067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:11.899058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:37565)
0807 19:56:11.899689 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:11.899707 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:11.899855 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:11.900197 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:11.900202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:11.900783 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:11.901023 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:11.901040 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.902086 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.902092 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:11.903046 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:11.903060 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.903872 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.903879 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:11.904060 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:11.904700 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:11.904719 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:11.908372 (+ 3653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":334,"threads_started":1}
W20260807 19:56:11.908879 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:11.899126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:37565 (local address 127.5.197.190:38125)
0807 19:56:11.899337 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:11.899345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:11.899806 (+ 461us) server_negotiation.cc:407] Connection header received
0807 19:56:11.899979 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:11.899985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:11.900052 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:11.900137 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:11.901195 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.901939 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.903192 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:11.903708 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:11.903851 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:11.908613 (+ 4762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:37565: BlockingRecv error: recv got EOF from 127.5.197.129:37565 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 19:56:12 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:12 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:12.021730 19068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:12.012569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:52633)
0807 19:56:12.013138 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:12.013160 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:12.013287 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:12.013604 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:12.013607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:12.014032 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:12.014225 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:12.014236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.015279 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.015283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:12.016357 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:12.016373 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.017038 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.017042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:12.017167 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:12.017791 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:12.017810 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:12.021369 (+ 3559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":337,"threads_started":1}
W20260807 19:56:12.021908 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:12.012696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:52633 (local address 127.5.197.190:38125)
0807 19:56:12.012856 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:12.012862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:12.013237 (+ 375us) server_negotiation.cc:407] Connection header received
0807 19:56:12.013394 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:12.013397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:12.013460 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:12.013548 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:12.014345 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.015107 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.016488 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.016879 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.016975 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:12.021651 (+ 4676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:52633: BlockingRecv error: recv got EOF from 127.5.197.131:52633 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 19:56:12 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:12 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:12.424888 19070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:12.415373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:52127)
0807 19:56:12.415953 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:12.415975 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:12.416127 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:12.416476 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:12.416481 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:12.416933 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:12.417127 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:12.417137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.418299 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.418304 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:12.419350 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:12.419375 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.420120 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.420127 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:12.420283 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:12.420885 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:12.420904 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:12.424526 (+ 3622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":333,"threads_started":1}
W20260807 19:56:12.425010 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:12.415505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:52127 (local address 127.5.197.190:38125)
0807 19:56:12.415745 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:12.415752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:12.416061 (+ 309us) server_negotiation.cc:407] Connection header received
0807 19:56:12.416249 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:12.416254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:12.416323 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:12.416411 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:12.417277 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.418149 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.419495 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.419962 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.420073 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:12.424787 (+ 4714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:52127: BlockingRecv error: recv got EOF from 127.5.197.130:52127 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 19:56:12 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:12 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:12.919474 19071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:12.909920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:46047)
0807 19:56:12.910447 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:12.910471 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:12.910632 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:12.910991 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:12.910996 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:12.911592 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:12.911871 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:12.911886 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.913134 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.913140 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:12.914063 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:12.914077 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.914820 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.914827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:12.915020 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:12.915725 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:12.915744 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:12.919230 (+ 3486us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":267,"threads_started":1}
W20260807 19:56:12.919744 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:12.910175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:46047 (local address 127.5.197.190:38125)
0807 19:56:12.910438 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:12.910442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:12.910559 (+ 117us) server_negotiation.cc:407] Connection header received
0807 19:56:12.910747 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:12.910751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:12.910826 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:12.910935 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:12.912022 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.912983 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.914216 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:12.914664 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:12.914796 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:12.919460 (+ 4664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:46047: BlockingRecv error: recv got EOF from 127.5.197.129:46047 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 07 19:56:13 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:13 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:13.031821 19072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:13.023050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:42281)
0807 19:56:13.023618 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:13.023645 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:13.023817 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:13.024107 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:13.024110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:13.024523 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:13.024721 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:13.024731 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.025661 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.025665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:13.026588 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:13.026599 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.027244 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.027248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:13.027373 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:13.027947 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:13.027964 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:13.031512 (+ 3548us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":315,"threads_started":1}
W20260807 19:56:13.031991 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:13.023102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:42281 (local address 127.5.197.190:38125)
0807 19:56:13.023334 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:13.023341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:13.023761 (+ 420us) server_negotiation.cc:407] Connection header received
0807 19:56:13.023923 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:13.023927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:13.023992 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:13.024071 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:13.024835 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.025547 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.026694 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.027126 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.027217 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:13.031769 (+ 4552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:42281: BlockingRecv error: recv got EOF from 127.5.197.131:42281 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 19:56:13 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:13 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:13.435285 19073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:13.425953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:39277)
0807 19:56:13.426541 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:13.426562 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:13.426704 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:13.427104 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:13.427108 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:13.427609 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:13.427839 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:13.427850 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.429149 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.429153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:13.430083 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:13.430097 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.430804 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.430808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:13.430959 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:13.431553 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:13.431570 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:13.435037 (+ 3467us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":296,"threads_started":1}
W20260807 19:56:13.435514 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:13.426101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:39277 (local address 127.5.197.190:38125)
0807 19:56:13.426332 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:13.426339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:13.426648 (+ 309us) server_negotiation.cc:407] Connection header received
0807 19:56:13.426853 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:13.426858 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:13.426926 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:13.427031 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:13.427989 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.428999 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.430219 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.430655 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.430758 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:13.435272 (+ 4514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:39277: BlockingRecv error: recv got EOF from 127.5.197.130:39277 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 19:56:13 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:13 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:13.930639 19075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:13.920706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:58081)
0807 19:56:13.921347 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:13.921372 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:13.921536 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:13.922015 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:13.922021 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:13.922565 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:13.922802 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:13.922819 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.924089 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.924094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:13.925113 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:13.925128 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.925832 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.925837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:13.925970 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:13.926635 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:13.926655 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:13.930365 (+ 3710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":315,"threads_started":1}
W20260807 19:56:13.930836 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:13.920834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58081 (local address 127.5.197.190:38125)
0807 19:56:13.921027 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:13.921033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:13.921483 (+ 450us) server_negotiation.cc:407] Connection header received
0807 19:56:13.921668 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:13.921673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:13.921799 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:13.921909 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:13.922969 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.923925 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.925290 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:13.925693 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:13.925794 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:13.930610 (+ 4816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:58081: BlockingRecv error: recv got EOF from 127.5.197.129:58081 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 19:56:14 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:14 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:14.041663 19076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:14.032963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:58041)
0807 19:56:14.033497 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:14.033518 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:14.033656 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:14.033983 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:14.033988 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:14.034405 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:14.034575 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:14.034584 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.035593 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.035598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:14.036569 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:14.036582 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.037271 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.037277 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:14.037481 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:14.038036 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:14.038053 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:14.041416 (+ 3363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":255,"threads_started":1}
W20260807 19:56:14.041846 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:14.033019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:58041 (local address 127.5.197.190:38125)
0807 19:56:14.033221 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:14.033227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:14.033606 (+ 379us) server_negotiation.cc:407] Connection header received
0807 19:56:14.033774 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:14.033779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:14.033853 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:14.033935 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:14.034720 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.035451 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.036710 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.037131 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.037241 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:14.041608 (+ 4367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:58041: BlockingRecv error: recv got EOF from 127.5.197.131:58041 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 19:56:14 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:14 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:14.446010 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:14.436440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:49675)
0807 19:56:14.436980 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:14.437003 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:14.437132 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:14.437416 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:14.437419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:14.437844 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:14.438021 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:14.438032 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.439180 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.439187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:14.440469 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:14.440485 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.441191 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.441197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:14.441375 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:14.441984 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:14.442004 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:14.445653 (+ 3649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":290,"threads_started":1}
W20260807 19:56:14.446223 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:14.436608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:49675 (local address 127.5.197.190:38125)
0807 19:56:14.436903 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:14.436909 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:14.437082 (+ 173us) server_negotiation.cc:407] Connection header received
0807 19:56:14.437224 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:14.437227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:14.437291 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:14.437379 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:14.438144 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.439030 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.440614 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.441040 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.441154 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:14.445940 (+ 4786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:49675: BlockingRecv error: recv got EOF from 127.5.197.130:49675 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 07 19:56:14 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:14 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:14.940721 19079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:14.931625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:49193)
0807 19:56:14.932137 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:14.932153 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:14.932273 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:14.932628 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:14.932631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:14.933055 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:14.933223 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:14.933234 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.934231 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.934235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:14.935199 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:14.935212 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.936218 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.936224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:14.936367 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:14.937012 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:14.937029 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:14.940444 (+ 3415us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":242,"threads_started":1}
W20260807 19:56:14.940938 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:14.931752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:49193 (local address 127.5.197.190:38125)
0807 19:56:14.931972 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:14.931979 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:14.932228 (+ 249us) server_negotiation.cc:407] Connection header received
0807 19:56:14.932417 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:14.932422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:14.932489 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:14.932574 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:14.933340 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.934110 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.935363 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:14.936065 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:14.936193 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:14.940659 (+ 4466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:49193: BlockingRecv error: recv got EOF from 127.5.197.129:49193 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 19:56:15 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:15 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:15.052217 19081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:15.042702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:34037)
0807 19:56:15.043218 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:15.043240 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:15.043378 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:15.043736 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:15.043741 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:15.044159 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:15.044330 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:15.044340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.045367 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.045371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:15.046384 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:15.046397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.047113 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.047119 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:15.047285 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:15.047922 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:15.047941 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:15.051948 (+ 4007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":276,"threads_started":1}
W20260807 19:56:15.052323 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:15.042781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:34037 (local address 127.5.197.190:38125)
0807 19:56:15.042973 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:15.042979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:15.043324 (+ 345us) server_negotiation.cc:407] Connection header received
0807 19:56:15.043494 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:15.043498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:15.043577 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:15.043682 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:15.044489 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.045217 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.046525 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.046964 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.047077 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:15.052131 (+ 5054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:34037: BlockingRecv error: recv got EOF from 127.5.197.131:34037 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 19:56:15 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:15 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:15.459064 19082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:15.446970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:53279)
0807 19:56:15.447511 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:15.447532 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:15.447657 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:15.448046 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:15.448049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:15.448562 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:15.448726 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:15.448736 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.449746 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.449751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:15.450693 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:15.450706 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.451411 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.451415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:15.451545 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:15.455044 (+ 3499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:15.455065 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:15.458735 (+ 3670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":276,"threads_started":1}
W20260807 19:56:15.459242 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:15.447157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:53279 (local address 127.5.197.190:38125)
0807 19:56:15.447364 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:15.447369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:15.447629 (+ 260us) server_negotiation.cc:407] Connection header received
0807 19:56:15.447843 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:15.447847 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:15.447921 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:15.448011 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:15.448871 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.449596 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.450827 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.451282 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.451381 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:15.458986 (+ 7605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:53279: BlockingRecv error: recv got EOF from 127.5.197.130:53279 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 19:56:15 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:15 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:15.951289 19084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:15.941952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:52163)
0807 19:56:15.942492 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:15.942510 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:15.942637 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:15.943017 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:15.943021 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:15.943464 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:15.943648 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:15.943659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.944729 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.944735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:15.945869 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:15.945884 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.946682 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.946688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:15.946868 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:15.947494 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:15.947514 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:15.951021 (+ 3507us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":308,"threads_started":1}
W20260807 19:56:15.951449 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:15.942091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:52163 (local address 127.5.197.190:38125)
0807 19:56:15.942327 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:15.942333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:15.942595 (+ 262us) server_negotiation.cc:407] Connection header received
0807 19:56:15.942759 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:15.942764 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:15.942840 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:15.942928 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:15.943828 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.944545 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.946007 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:15.946519 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:15.946638 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:15.951214 (+ 4576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:52163: BlockingRecv error: recv got EOF from 127.5.197.129:52163 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 19:56:16 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:16 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:16.062611 19085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:16.053321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:42671)
0807 19:56:16.053868 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:16.053891 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:16.054022 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:16.054376 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:16.054382 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:16.054883 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:16.055045 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:16.055055 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.056195 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.056199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:16.057139 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:16.057152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.057873 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.057880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:16.058061 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:16.058641 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:16.058660 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:16.062289 (+ 3629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":287,"threads_started":1}
W20260807 19:56:16.062790 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:16.053439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:42671 (local address 127.5.197.190:38125)
0807 19:56:16.053625 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:16.053630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:16.053963 (+ 333us) server_negotiation.cc:407] Connection header received
0807 19:56:16.054136 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:16.054140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:16.054205 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:16.054310 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:16.055210 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.056044 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.057297 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.057717 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.057835 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:16.062536 (+ 4701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:42671: BlockingRecv error: recv got EOF from 127.5.197.131:42671 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 19:56:16 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:16 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:16.469473 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:16.460201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:33011)
0807 19:56:16.460727 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:16.460754 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:16.460876 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:16.461228 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:16.461233 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:16.461735 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:16.461948 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:16.461960 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.463115 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.463119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:16.464129 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:16.464142 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.464886 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.464891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:16.465067 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:16.465696 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:16.465716 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:16.469187 (+ 3471us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":279,"threads_started":1}
W20260807 19:56:16.469754 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:16.460321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:33011 (local address 127.5.197.190:38125)
0807 19:56:16.460553 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:16.460557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:16.460837 (+ 280us) server_negotiation.cc:407] Connection header received
0807 19:56:16.461008 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:16.461012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:16.461076 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:16.461159 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:16.462105 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.462957 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.464272 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.464705 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.464841 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:16.469484 (+ 4643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:33011: BlockingRecv error: recv got EOF from 127.5.197.130:33011 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 19:56:16 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:16 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:16.961169 19087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:16.952232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:58083)
0807 19:56:16.952899 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:16.952919 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:16.953062 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:16.953474 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:16.953480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:16.954000 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:16.954215 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:16.954229 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.955276 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.955282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:16.956248 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:16.956262 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.956952 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.956958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:16.957103 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:16.957627 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:16.957643 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:16.960816 (+ 3173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":297,"threads_started":1}
W20260807 19:56:16.961270 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:16.952362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58083 (local address 127.5.197.190:38125)
0807 19:56:16.952564 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:16.952570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:16.953007 (+ 437us) server_negotiation.cc:407] Connection header received
0807 19:56:16.953178 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:16.953184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:16.953258 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:16.953348 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:16.954382 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.955143 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.956398 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:16.956800 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:16.956906 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:16.961043 (+ 4137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:58083: BlockingRecv error: recv got EOF from 127.5.197.129:58083 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 19:56:17 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:17 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:17.072378 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:17.063572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:57321)
0807 19:56:17.064051 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:17.064071 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:17.064189 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:17.064462 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:17.064464 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:17.064890 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:17.065063 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:17.065072 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.066055 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.066059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:17.067015 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:17.067029 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.067814 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.067819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:17.067945 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:17.068468 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:17.068485 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:17.072141 (+ 3656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":275,"threads_started":1}
W20260807 19:56:17.072546 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:17.063715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:57321 (local address 127.5.197.190:38125)
0807 19:56:17.063917 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:17.063924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:17.064145 (+ 221us) server_negotiation.cc:407] Connection header received
0807 19:56:17.064278 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:17.064281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:17.064342 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:17.064435 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:17.065192 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.065922 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.067229 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.067643 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.067793 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:17.072318 (+ 4525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:57321: BlockingRecv error: recv got EOF from 127.5.197.131:57321 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 19:56:17 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:17 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:17.479977 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:17.470683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:49847)
0807 19:56:17.471286 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:17.471308 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:17.471471 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:17.471911 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:17.471916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:17.472388 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:17.472566 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:17.472575 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.473728 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.473732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:17.474680 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:17.474692 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.475458 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.475462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:17.475575 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:17.476179 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:17.476197 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:17.479581 (+ 3384us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":282,"threads_started":1}
W20260807 19:56:17.480067 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:17.470806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:49847 (local address 127.5.197.190:38125)
0807 19:56:17.471001 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:17.471006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:17.471409 (+ 403us) server_negotiation.cc:407] Connection header received
0807 19:56:17.471600 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:17.471606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:17.471720 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:17.471834 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:17.472697 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.473583 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.474828 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.475329 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.475435 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:17.479836 (+ 4401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:49847: BlockingRecv error: recv got EOF from 127.5.197.130:49847 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 19:56:17 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:17 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:17.972159 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:17.962377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:58979)
0807 19:56:17.962996 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:17.963014 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:17.963145 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:17.963491 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:17.963494 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:17.963948 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:17.964177 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:17.964188 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.965280 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.965287 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:17.966302 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:17.966318 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.967103 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.967110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:17.967273 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:17.968087 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:17.968112 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:17.971901 (+ 3789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":332,"threads_started":1}
W20260807 19:56:17.972445 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:17.962451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58979 (local address 127.5.197.190:38125)
0807 19:56:17.962632 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:17.962637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:17.963122 (+ 485us) server_negotiation.cc:407] Connection header received
0807 19:56:17.963292 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:17.963296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:17.963366 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:17.963454 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:17.964367 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.965107 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.966461 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:17.966881 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:17.966997 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:17.972174 (+ 5177us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:58979: BlockingRecv error: recv got EOF from 127.5.197.129:58979 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 19:56:18 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:18 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:18.082288 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:18.073269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:55777)
0807 19:56:18.073860 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:18.073882 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:18.074005 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:18.074310 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:18.074314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:18.074775 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:18.074968 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:18.074979 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.076026 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.076030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:18.077089 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:18.077104 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.077951 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.077957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:18.078121 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:18.078679 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:18.078696 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:18.082013 (+ 3317us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":256,"threads_started":1}
W20260807 19:56:18.082449 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:18.073450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:55777 (local address 127.5.197.190:38125)
0807 19:56:18.073713 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:18.073719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:18.073957 (+ 238us) server_negotiation.cc:407] Connection header received
0807 19:56:18.074105 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:18.074109 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:18.074176 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:18.074260 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:18.075111 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.075908 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.077226 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.077787 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.077922 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:18.082224 (+ 4302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:55777: BlockingRecv error: recv got EOF from 127.5.197.131:55777 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 07 19:56:18 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:18 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:18.491048 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:18.481189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:39673)
0807 19:56:18.481904 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:18.481925 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:18.482070 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:18.482503 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:18.482509 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:18.482959 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:18.483153 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:18.483164 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.484473 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.484478 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:18.485434 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:18.485448 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.486225 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.486232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:18.486387 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:18.486960 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:18.486977 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:18.490785 (+ 3808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":447,"threads_started":1}
W20260807 19:56:18.491371 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:18.481325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:39673 (local address 127.5.197.190:38125)
0807 19:56:18.481552 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:18.481559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:18.482126 (+ 567us) server_negotiation.cc:407] Connection header received
0807 19:56:18.482257 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:18.482261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:18.482329 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:18.482423 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:18.483315 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.484315 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.485598 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.486031 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.486148 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:18.491058 (+ 4910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:39673: BlockingRecv error: recv got EOF from 127.5.197.130:39673 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 19:56:18 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:18 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:18.982528 19094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:18.973161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:60891)
0807 19:56:18.973778 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:18.973794 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:18.973935 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:18.974275 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:18.974280 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:18.974769 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:18.974930 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:18.974940 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.976077 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.976081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:18.977061 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:18.977075 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.977867 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.977874 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:18.978064 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:18.978702 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:18.978722 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:18.982182 (+ 3460us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":334,"threads_started":1}
W20260807 19:56:18.982668 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:18.973343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:60891 (local address 127.5.197.190:38125)
0807 19:56:18.973626 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:18.973632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:18.973884 (+ 252us) server_negotiation.cc:407] Connection header received
0807 19:56:18.974059 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:18.974063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:18.974125 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:18.974219 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:18.975087 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.975921 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.977243 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:18.977707 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:18.977822 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:18.982432 (+ 4610us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:60891: BlockingRecv error: recv got EOF from 127.5.197.129:60891 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 07 19:56:19 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:19 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:19.092660 19096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:19.083297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:37013)
0807 19:56:19.083891 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:19.083914 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:19.084040 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:19.084313 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:19.084316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:19.084710 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:19.084908 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:19.084917 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.085965 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.085970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:19.086958 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:19.086974 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.087844 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.087849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:19.088013 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:19.088672 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:19.088702 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:19.092299 (+ 3597us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":261,"threads_started":1}
W20260807 19:56:19.092742 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:19.083400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:37013 (local address 127.5.197.190:38125)
0807 19:56:19.083625 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:19.083632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:19.083991 (+ 359us) server_negotiation.cc:407] Connection header received
0807 19:56:19.084130 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:19.084133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:19.084201 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:19.084285 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:19.085025 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.085776 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.087098 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.087637 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.087780 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:19.092501 (+ 4721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:37013: BlockingRecv error: recv got EOF from 127.5.197.131:37013 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 19:56:19 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:19 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:19.501387 19097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:19.492009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:46313)
0807 19:56:19.492519 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:19.492540 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:19.492657 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:19.492913 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:19.492916 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:19.493398 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:19.493561 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:19.493571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.494609 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.494614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:19.495695 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:19.495711 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.496454 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.496459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:19.496603 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:19.497213 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:19.497232 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:19.501128 (+ 3896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":262,"threads_started":1}
W20260807 19:56:19.501636 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:19.492065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:46313 (local address 127.5.197.190:38125)
0807 19:56:19.492241 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:19.492246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:19.492607 (+ 361us) server_negotiation.cc:407] Connection header received
0807 19:56:19.492741 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:19.492745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:19.492805 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:19.492884 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:19.493686 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.494443 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.495850 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.496298 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.496393 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:19.501398 (+ 5005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:46313: BlockingRecv error: recv got EOF from 127.5.197.130:46313 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 19:56:19 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:19 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:19.992818 19100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:19.983453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:58237)
0807 19:56:19.983967 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:19.983984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:19.984122 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:19.984460 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:19.984467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:19.985011 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:19.985261 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:19.985276 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.986280 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.986283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:19.987306 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:19.987320 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.988088 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.988092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:19.988219 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:19.988844 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:19.988865 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:19.992570 (+ 3705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":285,"threads_started":1}
W20260807 19:56:19.992929 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:19.983496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58237 (local address 127.5.197.190:38125)
0807 19:56:19.983709 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:19.983717 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:19.984066 (+ 349us) server_negotiation.cc:407] Connection header received
0807 19:56:19.984235 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:19.984239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:19.984303 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:19.984404 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:19.985424 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.986152 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.987426 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:19.987942 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:19.988033 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:19.992719 (+ 4686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:58237: BlockingRecv error: recv got EOF from 127.5.197.129:58237 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 19:56:20 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:20 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:20.102921 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:20.093773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:36589)
0807 19:56:20.094299 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:20.094322 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:20.094452 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:20.094756 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:20.094759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:20.095186 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:20.095365 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:20.095375 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.096456 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.096461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:20.097461 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:20.097477 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.098142 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.098146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:20.098287 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:20.098885 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:20.098902 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:20.102666 (+ 3764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":265,"threads_started":1}
W20260807 19:56:20.103145 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:20.093936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:36589 (local address 127.5.197.190:38125)
0807 19:56:20.094206 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:20.094213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:20.094402 (+ 189us) server_negotiation.cc:407] Connection header received
0807 19:56:20.094550 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:20.094554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:20.094622 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:20.094708 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:20.095495 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.096287 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.097595 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.098015 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.098106 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:20.102879 (+ 4773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:36589: BlockingRecv error: recv got EOF from 127.5.197.131:36589 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 07 19:56:20 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:20 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:20.514339 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:20.502406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:48807)
0807 19:56:20.502931 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:20.502954 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:20.503081 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:20.503380 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:20.503385 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:20.503866 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:20.504042 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:20.504052 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.505131 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.505135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:20.506154 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:20.506168 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.506907 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.506912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:20.507046 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:20.510180 (+ 3134us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:20.510206 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:20.514078 (+ 3872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":283,"threads_started":1}
W20260807 19:56:20.514479 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:20.502483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:48807 (local address 127.5.197.190:38125)
0807 19:56:20.502705 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:20.502713 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:20.503034 (+ 321us) server_negotiation.cc:407] Connection header received
0807 19:56:20.503191 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:20.503195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:20.503262 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:20.503346 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:20.504171 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.504993 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.506278 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.506727 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.506824 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:20.514278 (+ 7454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:48807: BlockingRecv error: recv got EOF from 127.5.197.130:48807 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 19:56:20 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:20 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:21.002377 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:20.993816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:49361)
0807 19:56:20.994322 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:20.994343 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:20.994467 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:20.994755 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:20.994757 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:20.995178 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:20.995377 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:20.995386 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.996456 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.996462 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:20.997440 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:20.997456 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.998108 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.998112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:20.998230 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:20.998790 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:20.998808 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:21.002106 (+ 3298us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":275,"threads_started":1}
W20260807 19:56:21.002517 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:20.993955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:49361 (local address 127.5.197.190:38125)
0807 19:56:20.994115 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:20.994120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:20.994408 (+ 288us) server_negotiation.cc:407] Connection header received
0807 19:56:20.994572 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:20.994575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:20.994647 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:20.994719 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:20.995518 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.996309 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.997577 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:20.997989 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:20.998080 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:21.002301 (+ 4221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:49361: BlockingRecv error: recv got EOF from 127.5.197.129:49361 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 19:56:21 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:21 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:21.112793 19108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:21.103897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:36163)
0807 19:56:21.104436 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:21.104459 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:21.104576 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:21.104930 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:21.104935 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:21.105351 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:21.105530 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:21.105540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.106542 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.106546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:21.107533 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:21.107546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.108365 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.108371 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:21.108527 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:21.109070 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:21.109088 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:21.112524 (+ 3436us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":296,"threads_started":1}
W20260807 19:56:21.112912 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:21.103943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:36163 (local address 127.5.197.190:38125)
0807 19:56:21.104100 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:21.104104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:21.104521 (+ 417us) server_negotiation.cc:407] Connection header received
0807 19:56:21.104681 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:21.104685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:21.104747 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:21.104862 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:21.105682 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.106401 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.107714 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.108210 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.108337 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:21.112707 (+ 4370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:36163: BlockingRecv error: recv got EOF from 127.5.197.131:36163 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 19:56:21 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:21 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:21.524570 19109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:21.515327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:44307)
0807 19:56:21.515872 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:21.515895 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:21.516025 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:21.516443 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:21.516448 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:21.516925 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:21.517123 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:21.517134 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.518196 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.518200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:21.519214 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:21.519235 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.519951 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.519956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:21.520081 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:21.520743 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:21.520762 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:21.524223 (+ 3461us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":308,"threads_started":1}
W20260807 19:56:21.524787 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:21.515410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:44307 (local address 127.5.197.190:38125)
0807 19:56:21.515605 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:21.515611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:21.515984 (+ 373us) server_negotiation.cc:407] Connection header received
0807 19:56:21.516161 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:21.516165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:21.516287 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:21.516389 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:21.517260 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.518056 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.519349 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:21.519821 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:21.519930 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:21.524510 (+ 4580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:44307: BlockingRecv error: recv got EOF from 127.5.197.130:44307 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 19:56:22 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:22 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:22.012571 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:22.003423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:55189)
0807 19:56:22.004110 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:22.004128 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:22.004277 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:22.004609 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:22.004614 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:22.005118 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:22.005315 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:22.005326 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.006366 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.006371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:22.007326 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:22.007339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.008116 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.008123 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:22.008304 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:22.008895 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:22.008913 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:22.012183 (+ 3270us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":370,"threads_started":1}
W20260807 19:56:22.012674 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:22.003536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:55189 (local address 127.5.197.190:38125)
0807 19:56:22.003817 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:22.003825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:22.004216 (+ 391us) server_negotiation.cc:407] Connection header received
0807 19:56:22.004399 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:22.004404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:22.004470 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:22.004552 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:22.005471 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.006206 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.007467 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.007938 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.008049 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:22.012432 (+ 4383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:55189: BlockingRecv error: recv got EOF from 127.5.197.129:55189 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 07 19:56:22 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:22 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:22.122987 19115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:22.113963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:37531)
0807 19:56:22.114530 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:22.114554 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:22.114700 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:22.115059 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:22.115064 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:22.115528 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:22.115766 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:22.115778 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.116804 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.116810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:22.117723 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:22.117737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.118479 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.118485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:22.118653 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:22.119234 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:22.119251 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:22.122674 (+ 3423us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":306,"threads_started":1}
W20260807 19:56:22.123415 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:22.114074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:37531 (local address 127.5.197.190:38125)
0807 19:56:22.114340 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:22.114347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:22.114651 (+ 304us) server_negotiation.cc:407] Connection header received
0807 19:56:22.114824 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:22.114842 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:22.114912 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:22.114996 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:22.115914 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.116658 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.117875 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.118318 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.118434 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:22.122941 (+ 4507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:37531: BlockingRecv error: recv got EOF from 127.5.197.131:37531 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 19:56:22 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:22 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:22.535466 19116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:22.525790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:57649)
0807 19:56:22.526395 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:22.526416 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:22.526557 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:22.526944 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:22.526949 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:22.527406 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:22.527591 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:22.527602 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.528700 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.528705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:22.529699 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:22.529715 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.530573 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.530580 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:22.530744 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:22.531359 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:22.531380 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:22.535044 (+ 3664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":328,"threads_started":1}
W20260807 19:56:22.535532 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:22.525897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:57649 (local address 127.5.197.190:38125)
0807 19:56:22.526120 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:22.526127 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:22.526506 (+ 379us) server_negotiation.cc:407] Connection header received
0807 19:56:22.526719 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:22.526724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:22.526802 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:22.526887 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:22.527768 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.528536 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.529849 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:22.530371 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:22.530490 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:22.535290 (+ 4800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:57649: BlockingRecv error: recv got EOF from 127.5.197.130:57649 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 19:56:23 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:23 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:23.022113 19117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:23.013643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:56673)
0807 19:56:23.014124 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:23.014140 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:23.014254 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:23.014510 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:23.014514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:23.014932 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:23.015091 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:23.015100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.016088 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.016092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:23.016988 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:23.016999 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.017616 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.017620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:23.017741 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:23.018416 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:23.018433 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:23.021884 (+ 3451us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":262,"threads_started":1}
W20260807 19:56:23.022316 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:23.013696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:56673 (local address 127.5.197.190:38125)
0807 19:56:23.013861 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:23.013866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:23.014202 (+ 336us) server_negotiation.cc:407] Connection header received
0807 19:56:23.014339 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:23.014342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:23.014403 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:23.014481 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:23.015197 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.015961 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.017091 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.017512 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.017602 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:23.022073 (+ 4471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:56673: BlockingRecv error: recv got EOF from 127.5.197.129:56673 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 07 19:56:23 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:23 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:23.133682 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:23.124012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:47283)
0807 19:56:23.124635 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:23.124656 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:23.124798 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:23.125139 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:23.125143 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:23.125637 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:23.125820 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:23.125829 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.126884 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.126889 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:23.127900 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:23.127915 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.128774 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.128781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:23.128947 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:23.129532 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:23.129550 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:23.133300 (+ 3750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":347,"threads_started":1}
W20260807 19:56:23.133752 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:23.124114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:47283 (local address 127.5.197.190:38125)
0807 19:56:23.124335 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:23.124342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:23.124749 (+ 407us) server_negotiation.cc:407] Connection header received
0807 19:56:23.124923 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:23.124928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:23.124994 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:23.125079 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:23.125980 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.126731 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.128044 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.128561 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.128691 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:23.133537 (+ 4846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:47283: BlockingRecv error: recv got EOF from 127.5.197.131:47283 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 19:56:23 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:23 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:23.545801 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:23.536549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:41841)
0807 19:56:23.537089 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:23.537112 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:23.537294 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:23.537639 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:23.537644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:23.538081 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:23.538302 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:23.538312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.539353 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.539358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:23.540392 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:23.540407 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.541102 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.541106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:23.541230 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:23.541804 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:23.541823 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:23.545489 (+ 3666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":304,"threads_started":1}
W20260807 19:56:23.545976 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:23.536728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:41841 (local address 127.5.197.190:38125)
0807 19:56:23.536907 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:23.536912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:23.537230 (+ 318us) server_negotiation.cc:407] Connection header received
0807 19:56:23.537388 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:23.537392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:23.537491 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:23.537573 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:23.538441 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.539174 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.540508 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:23.540987 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:23.541079 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:23.545715 (+ 4636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:41841: BlockingRecv error: recv got EOF from 127.5.197.130:41841 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 19:56:24 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:24 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.129@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:24.035485 19120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:24.023418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.129:39965)
0807 19:56:24.024171 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:24.024191 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:24.024329 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:24.024723 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:24.024729 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:24.025223 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:24.025467 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:24.025481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.028815 (+ 3334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.028821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:24.030200 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:24.030216 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.030942 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.030948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:24.031124 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:24.031684 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:24.031712 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:24.035232 (+ 3520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":309,"threads_started":1}
W20260807 19:56:24.035686 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:24.023526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:39965 (local address 127.5.197.190:38125)
0807 19:56:24.023873 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:24.023880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:24.024276 (+ 396us) server_negotiation.cc:407] Connection header received
0807 19:56:24.024475 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:24.024480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:24.024567 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:24.024673 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:24.025631 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.026676 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.030354 (+ 3678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.030785 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.030897 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:24.035426 (+ 4529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.129:39965: BlockingRecv error: recv got EOF from 127.5.197.129:39965 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 19:56:24 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:24 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.131@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:24.143651 19122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:24.134788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.131:39951)
0807 19:56:24.135267 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:24.135289 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:24.135423 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:24.135749 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:24.135754 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:24.136191 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:24.136357 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:24.136367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.137410 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.137415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:24.138455 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:24.138470 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.139281 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.139287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:24.139494 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:24.140079 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:24.140096 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:24.143322 (+ 3226us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":251,"threads_started":1}
W20260807 19:56:24.143821 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:24.134872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:39951 (local address 127.5.197.190:38125)
0807 19:56:24.135172 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:24.135178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:24.135374 (+ 196us) server_negotiation.cc:407] Connection header received
0807 19:56:24.135537 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:24.135542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:24.135607 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:24.135719 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:24.136503 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.137252 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.138589 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.139116 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.139212 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:24.143556 (+ 4344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.131:39951: BlockingRecv error: recv got EOF from 127.5.197.131:39951 (error 108)
Metrics: {"server-negotiator.queue_time_us":166}
Aug 07 19:56:24 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:56:24 dist-test-slave-6bbx krb5kdc[17548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.197.130@KRBTEST.COM for oryx/127.5.197.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:56:24.556237 19123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:24.547175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:38125 (local address 127.5.197.130:46955)
0807 19:56:24.547750 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:24.547772 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:24.547928 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:24.548311 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:24.548316 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:24.548821 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:24.549048 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:24.549059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.550080 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.550083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:24.551028 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:24.551041 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.551747 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.551752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:24.551905 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:24.552481 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:24.552499 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:24.555884 (+ 3385us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.197.190:38125: Server oryx/127.5.197.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":293,"threads_started":1}
W20260807 19:56:24.556365 18627 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:24.547272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:46955 (local address 127.5.197.190:38125)
0807 19:56:24.547465 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:24.547471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:24.547841 (+ 370us) server_negotiation.cc:407] Connection header received
0807 19:56:24.548042 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:24.548046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:24.548143 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:24.548245 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:24.549181 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.549967 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.551162 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.551575 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.551708 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:24.556126 (+ 4418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.197.130:46955: BlockingRecv error: recv got EOF from 127.5.197.130:46955 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:56:24.954985 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18413
I20260807 19:56:24.967718 19127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:24.956152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58250 (local address 127.5.197.129:41579)
0807 19:56:24.956778 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:24.956785 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:24.956812 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:56:24.956881 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:24.956887 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:24.957109 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:24.957348 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:24.958730 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.960001 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.961256 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.961870 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:24.961991 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:24.964498 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:24.964506 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:24.964521 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:24.964584 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:24.967170 (+ 2586us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.197.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 19:56:24.967464 (+ 294us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58250: Request ticket server kudu/127.5.197.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":312,"threads_started":1}
W20260807 19:56:24.967826 19127 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58250: Request ticket server kudu/127.5.197.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 19:56:24.967859 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18413: Not authorized: Client connection negotiation failed: client connection to 127.5.197.129:41579: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.197.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 19:56:24.968068 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 18413
I20260807 19:56:24.994087 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18630
I20260807 19:56:25.006652 19130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:24.995220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44614 (local address 127.5.197.130:45439)
0807 19:56:24.995885 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:24.995895 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:24.995930 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:56:24.996010 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:24.996018 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:24.996324 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:24.996556 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:24.997790 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:24.999084 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:25.000296 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:25.000866 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:25.000961 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:25.003272 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:25.003280 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:25.003295 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:25.003343 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:25.006110 (+ 2767us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.197.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 19:56:25.006408 (+ 298us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44614: Request ticket server kudu/127.5.197.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":249,"threads_started":1}
W20260807 19:56:25.006752 19130 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44614: Request ticket server kudu/127.5.197.130@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 19:56:25.006770 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18630: Not authorized: Client connection negotiation failed: client connection to 127.5.197.130:45439: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.197.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 19:56:25.006939 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 18630
I20260807 19:56:25.031607 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18850
I20260807 19:56:25.044198 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:25.032726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42174 (local address 127.5.197.131:35691)
0807 19:56:25.033335 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:25.033343 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:25.033370 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:56:25.033440 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:25.033448 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:25.033681 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:25.033854 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:25.035595 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:25.036710 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:25.037895 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:25.038433 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:25.038532 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:25.040948 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:25.040957 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:25.040972 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:25.041025 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:25.043464 (+ 2439us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.197.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 19:56:25.043937 (+ 473us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42174: Request ticket server kudu/127.5.197.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":282,"threads_started":1}
W20260807 19:56:25.044229 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18850: Not authorized: Client connection negotiation failed: client connection to 127.5.197.131:35691: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.197.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 19:56:25.044312 19132 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42174: Request ticket server kudu/127.5.197.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 19:56:25.044389 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 18850
I20260807 19:56:25.070775 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 18306
I20260807 19:56:25.072266 18400 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:25.194931 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 18306
2026-08-07T19:56:25Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21857 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T19:56:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:56:25Z Disabled control of system clock
I20260807 19:56:25.289628 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:39267
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:39267
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 19:56:25.629099 19141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:25.629376 19141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:25.629504 19141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:25.636526 19141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:56:25.636629 19141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:25.636667 19141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:25.636744 19141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:56:25.636806 19141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:56:25.645819 19141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:39267
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:39267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:25.647130 19141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:25.648999 19141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:25.660733 19149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:25.660698 19155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:25.660698 19153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:25.661552 19141 server_base.cc:1034] running on GCE node
I20260807 19:56:25.662353 19141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:25.663746 19141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:25.664961 19141 hybrid_clock.cc:648] HybridClock initialized: now 1786132585664907 us; error 45 us; skew 500 ppm
I20260807 19:56:25.665306 19141 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:25.671936 19141 webserver.cc:460] Webserver started at http://127.5.197.190:37509/ using document root <none> and password file <none>
I20260807 19:56:25.672686 19141 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:25.672793 19141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:25.673123 19141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:25.676100 19141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "46466dd679214f0ba30c9696f9cc605f"
format_stamp: "Formatted at 2026-08-07 19:56:25 on dist-test-slave-6bbx"
server_key: "7bcd4fe6a7cfba80c0234378f78e1755"
server_key_iv: "bcf1bcb4f984d62f965069afc82d9492"
server_key_version: "encryptionkey@0"
I20260807 19:56:25.676898 19141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "46466dd679214f0ba30c9696f9cc605f"
format_stamp: "Formatted at 2026-08-07 19:56:25 on dist-test-slave-6bbx"
server_key: "7bcd4fe6a7cfba80c0234378f78e1755"
server_key_iv: "bcf1bcb4f984d62f965069afc82d9492"
server_key_version: "encryptionkey@0"
I20260807 19:56:25.682057 19141 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 19:56:25.685503 19161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:25.686822 19141 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:56:25.686978 19141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "46466dd679214f0ba30c9696f9cc605f"
format_stamp: "Formatted at 2026-08-07 19:56:25 on dist-test-slave-6bbx"
server_key: "7bcd4fe6a7cfba80c0234378f78e1755"
server_key_iv: "bcf1bcb4f984d62f965069afc82d9492"
server_key_version: "encryptionkey@0"
I20260807 19:56:25.687175 19141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:25.700394 19141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:25.701164 19141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:25.701442 19141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:25.717592 19141 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:39267
I20260807 19:56:25.717612 19235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:39267 every 8 connection(s)
I20260807 19:56:25.718895 19141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:56:25.722705 19239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:25.725061 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 19141
I20260807 19:56:25.725288 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:56:25.726109 5910 external_mini_cluster.cc:1428] Setting key 51e765cc8de590aaea096952dda43d7f
I20260807 19:56:25.734933 19239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f: Bootstrap starting.
I20260807 19:56:25.738174 19239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:25.739466 19239 log.cc:824] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:25.740064 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:25.728508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39622 (local address 127.5.197.190:39267)
0807 19:56:25.729510 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:25.729522 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:25.729564 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:56:25.731225 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:25.731246 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:25.731722 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:25.732119 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:25.732693 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:25.733967 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:25.735297 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:25.736039 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:25.736204 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:25.737396 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:25.737404 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:25.737417 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:25.737952 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:25.738037 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:25.738059 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:25.738169 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:25.738427 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 19:56:25.738774 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":345,"threads_started":1}
I20260807 19:56:25.742763 19239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f: No bootstrap required, opened a new log
I20260807 19:56:25.749909 19239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46466dd679214f0ba30c9696f9cc605f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39267 } }
I20260807 19:56:25.750253 19239 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:25.750360 19239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46466dd679214f0ba30c9696f9cc605f, State: Initialized, Role: FOLLOWER
I20260807 19:56:25.750942 19239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46466dd679214f0ba30c9696f9cc605f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39267 } }
I20260807 19:56:25.751159 19239 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:56:25.751289 19239 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:56:25.751435 19239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:25.753762 19239 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46466dd679214f0ba30c9696f9cc605f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39267 } }
I20260807 19:56:25.754253 19239 leader_election.cc:302] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46466dd679214f0ba30c9696f9cc605f; no voters:
I20260807 19:56:25.754825 19239 leader_election.cc:288] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:56:25.754993 19247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:56:25.755642 19247 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [term 1 LEADER]: Becoming Leader. State: Replica: 46466dd679214f0ba30c9696f9cc605f, State: Running, Role: LEADER
I20260807 19:56:25.756268 19247 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46466dd679214f0ba30c9696f9cc605f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39267 } }
I20260807 19:56:25.757017 19239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:56:25.759342 19248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46466dd679214f0ba30c9696f9cc605f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46466dd679214f0ba30c9696f9cc605f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39267 } } }
I20260807 19:56:25.759303 19249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46466dd679214f0ba30c9696f9cc605f. Latest consensus state: current_term: 1 leader_uuid: "46466dd679214f0ba30c9696f9cc605f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46466dd679214f0ba30c9696f9cc605f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39267 } } }
I20260807 19:56:25.759827 19248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:25.759835 19249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:25.761399 19258 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:56:25.766453 19258 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:56:25.776031 19258 catalog_manager.cc:1347] Generated new cluster ID: 6cf2dcb190674736bc0ed763316c3a42
I20260807 19:56:25.776141 19258 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:56:25.797348 19258 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:56:25.798635 19258 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:56:25.811252 19258 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46466dd679214f0ba30c9696f9cc605f: Generated new TSK 0
I20260807 19:56:25.812255 19258 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:56:25.826895 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39267
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 19:56:26.167511 19274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:26.167819 19274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:26.167940 19274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:26.174831 19274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:26.174919 19274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:26.175053 19274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:56:26.183836 19274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39267
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:26.185217 19274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:26.187022 19274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:26.199947 19281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:26.199982 19288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:26.199918 19280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:26.200821 19274 server_base.cc:1034] running on GCE node
I20260807 19:56:26.201479 19274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:26.202356 19274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:26.203552 19274 hybrid_clock.cc:648] HybridClock initialized: now 1786132586203503 us; error 32 us; skew 500 ppm
I20260807 19:56:26.203863 19274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:26.205991 19274 webserver.cc:460] Webserver started at http://127.5.197.129:34553/ using document root <none> and password file <none>
I20260807 19:56:26.206655 19274 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:26.206744 19274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:26.207067 19274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:26.209779 19274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "86ff165c19a04285845bc3203046f929"
format_stamp: "Formatted at 2026-08-07 19:56:26 on dist-test-slave-6bbx"
server_key: "92f13722e9c9f683a2ddc040ceb10c21"
server_key_iv: "8500dfacf19c2d5ef4d6b657bc9412ed"
server_key_version: "encryptionkey@0"
I20260807 19:56:26.210532 19274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "86ff165c19a04285845bc3203046f929"
format_stamp: "Formatted at 2026-08-07 19:56:26 on dist-test-slave-6bbx"
server_key: "92f13722e9c9f683a2ddc040ceb10c21"
server_key_iv: "8500dfacf19c2d5ef4d6b657bc9412ed"
server_key_version: "encryptionkey@0"
I20260807 19:56:26.215337 19274 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260807 19:56:26.218582 19298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:26.219826 19274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 19:56:26.219985 19274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "86ff165c19a04285845bc3203046f929"
format_stamp: "Formatted at 2026-08-07 19:56:26 on dist-test-slave-6bbx"
server_key: "92f13722e9c9f683a2ddc040ceb10c21"
server_key_iv: "8500dfacf19c2d5ef4d6b657bc9412ed"
server_key_version: "encryptionkey@0"
I20260807 19:56:26.220167 19274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:26.236490 19274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:26.237233 19274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:26.237499 19274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:26.238366 19274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:26.239905 19274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:26.240003 19274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:26.240105 19274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:26.240181 19274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:26.270134 19274 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:45403
I20260807 19:56:26.270190 19463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:45403 every 8 connection(s)
I20260807 19:56:26.271386 19274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:56:26.276294 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 19274
I20260807 19:56:26.276510 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:56:26.277261 5910 external_mini_cluster.cc:1428] Setting key b8db1d08c3e3dca988f7ea6ae49b260b
I20260807 19:56:26.280025 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39267
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 19:56:26.284674 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:26.273806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:37735 (local address 127.5.197.190:39267)
0807 19:56:26.274186 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:26.274191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:26.275403 (+ 1212us) server_negotiation.cc:407] Connection header received
0807 19:56:26.277754 (+ 2351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:26.277759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:26.277831 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:26.277929 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:26.279005 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.279754 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.281905 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.282330 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.282423 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:26.283866 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:26.283870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:26.283874 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:26.283890 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:26.283930 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:26.283941 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:26.284008 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:26.284326 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 19:56:26.284410 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":193,"threads_started":1}
I20260807 19:56:26.285796 19468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:26.274393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39267 (local address 127.5.197.129:37735)
0807 19:56:26.275245 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:26.275280 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:26.277448 (+ 2168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:26.278187 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:26.278196 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:26.278278 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:26.278829 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:26.278858 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.279915 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.279920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:26.281759 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:26.281775 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.282542 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.282549 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:26.282822 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:26.283521 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:56:26.283524 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:26.283580 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:56:26.283693 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:26.284028 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:26.284038 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:26.284045 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 19:56:26.284219 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 19:56:26.284583 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":271,"threads_started":1}
I20260807 19:56:26.287213 19464 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39267
I20260807 19:56:26.287496 19464 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:26.288273 19464 heartbeater.cc:511] Master 127.5.197.190:39267 requested a full tablet report, sending...
I20260807 19:56:26.290236 19186 ts_manager.cc:194] Registered new tserver with Master: 86ff165c19a04285845bc3203046f929 (127.5.197.129:45403)
I20260807 19:56:26.291862 19186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.129:37735
W20260807 19:56:26.624104 19472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:26.624401 19472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:26.624526 19472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:26.631973 19472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:26.632086 19472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:26.632237 19472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:56:26.641487 19472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39267
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:26.642861 19472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:26.644793 19472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:26.657938 19480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:26.657997 19481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:26.657963 19483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:26.659206 19472 server_base.cc:1034] running on GCE node
I20260807 19:56:26.659948 19472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:26.660907 19472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:26.662168 19472 hybrid_clock.cc:648] HybridClock initialized: now 1786132586662042 us; error 103 us; skew 500 ppm
I20260807 19:56:26.662518 19472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:26.664863 19472 webserver.cc:460] Webserver started at http://127.5.197.130:35447/ using document root <none> and password file <none>
I20260807 19:56:26.665598 19472 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:26.665705 19472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:26.666039 19472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:26.669167 19472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "d7a499e82e494906885a76a0f8360e8f"
format_stamp: "Formatted at 2026-08-07 19:56:26 on dist-test-slave-6bbx"
server_key: "0675c2f07c2e440006c8b71c21e4ba23"
server_key_iv: "dab5fdff96a88759d7244e630cba1ab3"
server_key_version: "encryptionkey@0"
I20260807 19:56:26.670257 19472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "d7a499e82e494906885a76a0f8360e8f"
format_stamp: "Formatted at 2026-08-07 19:56:26 on dist-test-slave-6bbx"
server_key: "0675c2f07c2e440006c8b71c21e4ba23"
server_key_iv: "dab5fdff96a88759d7244e630cba1ab3"
server_key_version: "encryptionkey@0"
I20260807 19:56:26.676185 19472 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 19:56:26.679898 19497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:26.681319 19472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:56:26.681507 19472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "d7a499e82e494906885a76a0f8360e8f"
format_stamp: "Formatted at 2026-08-07 19:56:26 on dist-test-slave-6bbx"
server_key: "0675c2f07c2e440006c8b71c21e4ba23"
server_key_iv: "dab5fdff96a88759d7244e630cba1ab3"
server_key_version: "encryptionkey@0"
I20260807 19:56:26.681725 19472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:26.698127 19472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:26.698961 19472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:26.699251 19472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:26.700222 19472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:26.701682 19472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:26.701783 19472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:26.701932 19472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:26.702009 19472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:26.734817 19472 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:34709
I20260807 19:56:26.734869 19688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:34709 every 8 connection(s)
I20260807 19:56:26.736474 19472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:56:26.740420 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 19472
I20260807 19:56:26.740614 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:56:26.741176 5910 external_mini_cluster.cc:1428] Setting key 2c5fe8da56046e2a2ce29d360bce9009
I20260807 19:56:26.744400 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39267
--builtin_ntp_servers=127.5.197.148:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 19:56:26.750557 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:26.739419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:49663 (local address 127.5.197.190:39267)
0807 19:56:26.739607 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:26.739613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:26.741340 (+ 1727us) server_negotiation.cc:407] Connection header received
0807 19:56:26.743225 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:26.743231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:26.743305 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:26.743391 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:26.744999 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.745754 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.747889 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.748261 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.748366 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:26.749882 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:26.749887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:26.749890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:26.749909 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:26.749940 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:26.749951 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:26.750014 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:26.750249 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 19:56:26.750338 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 19:56:26.752101 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:26.740042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39267 (local address 127.5.197.130:49663)
0807 19:56:26.741152 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:26.741220 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:26.742966 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:26.743714 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:26.743726 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:26.743846 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:26.744813 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:26.744840 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.745910 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.745916 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:26.747760 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:26.747776 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:26.748493 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:26.748500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:26.748777 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:26.749516 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:56:26.749520 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:26.749573 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:56:26.749671 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:26.750035 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:26.750045 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:26.750053 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 19:56:26.750224 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 19:56:26.750617 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":317,"threads_started":1}
I20260807 19:56:26.753589 19689 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39267
I20260807 19:56:26.753923 19689 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:26.754894 19689 heartbeater.cc:511] Master 127.5.197.190:39267 requested a full tablet report, sending...
I20260807 19:56:26.756496 19186 ts_manager.cc:194] Registered new tserver with Master: d7a499e82e494906885a76a0f8360e8f (127.5.197.130:34709)
I20260807 19:56:26.757481 19186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.130:49663
W20260807 19:56:27.081625 19698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:27.081913 19698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:27.082008 19698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:27.089250 19698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:27.089354 19698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:27.089462 19698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:56:27.098490 19698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39267
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:27.099813 19698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:27.101588 19698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:27.114285 19704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:27.114332 19711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:27.114369 19708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:27.115337 19698 server_base.cc:1034] running on GCE node
I20260807 19:56:27.115947 19698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:27.116827 19698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:27.118068 19698 hybrid_clock.cc:648] HybridClock initialized: now 1786132587118008 us; error 50 us; skew 500 ppm
I20260807 19:56:27.118403 19698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:27.120662 19698 webserver.cc:460] Webserver started at http://127.5.197.131:45197/ using document root <none> and password file <none>
I20260807 19:56:27.121359 19698 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:27.121465 19698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:27.121788 19698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:27.124737 19698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "1b8bda7b37574b32aef44291a3a8ba02"
format_stamp: "Formatted at 2026-08-07 19:56:27 on dist-test-slave-6bbx"
server_key: "844b4058bdbe077315cebdc451412445"
server_key_iv: "4926029a243452a47458efb289633642"
server_key_version: "encryptionkey@0"
I20260807 19:56:27.125504 19698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "1b8bda7b37574b32aef44291a3a8ba02"
format_stamp: "Formatted at 2026-08-07 19:56:27 on dist-test-slave-6bbx"
server_key: "844b4058bdbe077315cebdc451412445"
server_key_iv: "4926029a243452a47458efb289633642"
server_key_version: "encryptionkey@0"
I20260807 19:56:27.130527 19698 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:56:27.133812 19719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:27.135053 19698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:56:27.135207 19698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "1b8bda7b37574b32aef44291a3a8ba02"
format_stamp: "Formatted at 2026-08-07 19:56:27 on dist-test-slave-6bbx"
server_key: "844b4058bdbe077315cebdc451412445"
server_key_iv: "4926029a243452a47458efb289633642"
server_key_version: "encryptionkey@0"
I20260807 19:56:27.135396 19698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:27.155213 19698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:27.156152 19698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:27.156446 19698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:27.157444 19698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:27.158950 19698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:27.159049 19698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:27.159158 19698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:27.159229 19698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:27.190416 19698 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:37115
I20260807 19:56:27.190487 19909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:37115 every 8 connection(s)
I20260807 19:56:27.191826 19698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:56:27.195046 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 19698
I20260807 19:56:27.195242 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:56:27.195847 5910 external_mini_cluster.cc:1428] Setting key ae616a7297942d593fe497ee7b6b0e6f
I20260807 19:56:27.204231 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:27.194377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:36653 (local address 127.5.197.190:39267)
0807 19:56:27.194552 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:27.194556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:27.196242 (+ 1686us) server_negotiation.cc:407] Connection header received
0807 19:56:27.198172 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:27.198178 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:27.198260 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:27.198344 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:27.199379 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.200156 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.201647 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.202044 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.202162 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:27.203437 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:27.203442 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:27.203445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:27.203462 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:27.203492 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:27.203503 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:27.203576 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:27.203819 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 19:56:27.203910 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:56:27.205142 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:27.195013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39267 (local address 127.5.197.131:36653)
0807 19:56:27.196086 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:27.196123 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:27.197918 (+ 1795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:27.198576 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:27.198584 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:27.198667 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:27.199210 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:27.199226 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.200301 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.200305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:27.201506 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:27.201518 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.202262 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.202269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:27.202480 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:27.203118 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:56:27.203121 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:27.203165 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:56:27.203241 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:27.203592 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:27.203603 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:27.203612 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 19:56:27.203797 (+ 185us) client_negotiation.cc:240] Negotiation successful
0807 19:56:27.204180 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":311,"threads_started":1}
I20260807 19:56:27.206609 19910 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39267
I20260807 19:56:27.206915 19910 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:27.207723 19910 heartbeater.cc:511] Master 127.5.197.190:39267 requested a full tablet report, sending...
I20260807 19:56:27.209059 19186 ts_manager.cc:194] Registered new tserver with Master: 1b8bda7b37574b32aef44291a3a8ba02 (127.5.197.131:37115)
I20260807 19:56:27.209956 19186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.131:36653
I20260807 19:56:27.211058 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 19:56:27.217077 19467 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:27.215552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39628 (local address 127.5.197.190:39267)
0807 19:56:27.215759 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:27.215765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:27.216273 (+ 508us) server_negotiation.cc:407] Connection header received
0807 19:56:27.216416 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:27.216420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:27.216493 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:27.216571 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:27.216886 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39628: BlockingRecv error: recv got EOF from 127.0.0.1:39628 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:56:27.217753 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 19274
I20260807 19:56:27.225347 19927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:27.218699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49284 (local address 127.5.197.129:45403)
0807 19:56:27.219167 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:27.219174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:27.219200 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:56:27.219254 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:27.219260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:27.219479 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:27.219605 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:27.220042 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.221014 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.222290 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.222831 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.222931 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:27.223984 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:27.223992 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:27.224005 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:27.224643 (+ 638us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:27.224688 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:27.224709 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:27.224800 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:27.224924 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 19:56:27.225056 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":235,"threads_started":1}
I20260807 19:56:27.226608 19458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:27.306782 19464 heartbeater.cc:503] Master 127.5.197.190:39267 was elected leader, sending a full tablet report...
I20260807 19:56:27.307955 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 19274
W20260807 19:56:27.330425 19164 connection.cc:535] server connection from 127.5.197.129:37735 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 19:56:27.330603 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 19472
I20260807 19:56:27.338673 19931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:27.331566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.5.197.130:34709)
0807 19:56:27.332119 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:27.332126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:27.332153 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:56:27.332221 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:27.332227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:27.332456 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:27.332609 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:27.333031 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.334071 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.335328 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.336086 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.336201 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:27.337197 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:27.337206 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:27.337220 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:27.337815 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:27.337871 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:27.337892 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:27.337994 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:27.338147 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 19:56:27.338305 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":294,"threads_started":1}
I20260807 19:56:27.340081 19682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:27.421947 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 19472
I20260807 19:56:27.444025 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 19698
I20260807 19:56:27.452008 19934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:27.445013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45230 (local address 127.5.197.131:37115)
0807 19:56:27.445720 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:27.445727 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:27.445759 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:56:27.445822 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:27.445829 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:27.446092 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:27.446248 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:27.446615 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.447691 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.448848 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:27.449405 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:27.449504 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:27.450451 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:27.450460 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:27.450473 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:27.451070 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:27.451119 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:27.451139 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:27.451239 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:27.451332 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 19:56:27.451455 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":376,"threads_started":1}
I20260807 19:56:27.453246 19902 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:27.535454 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 19698
I20260807 19:56:27.555894 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 19141
I20260807 19:56:27.557299 19228 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:27.662899 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 19141
2026-08-07T19:56:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2465 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T19:56:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:56:27Z Disabled control of system clock
I20260807 19:56:27.755834 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:39527
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:41533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:39527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 19:56:28.102495 19944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:28.102797 19944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:28.102882 19944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:28.110044 19944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:56:28.110152 19944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:28.110190 19944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:28.110246 19944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:56:28.110291 19944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:56:28.119313 19944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:39527
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:39527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:28.120584 19944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:28.122501 19944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:28.134171 19957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:28.134100 19956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:28.134125 19960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:28.134888 19944 server_base.cc:1034] running on GCE node
I20260807 19:56:28.135757 19944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:28.137212 19944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:28.138410 19944 hybrid_clock.cc:648] HybridClock initialized: now 1786132588138356 us; error 50 us; skew 500 ppm
I20260807 19:56:28.138751 19944 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:28.141042 19944 webserver.cc:460] Webserver started at http://127.5.197.190:37755/ using document root <none> and password file <none>
I20260807 19:56:28.141744 19944 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:28.141849 19944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:28.142204 19944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:28.147192 19944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "f2eb89e049d24d9286af3dfe58afb33d"
format_stamp: "Formatted at 2026-08-07 19:56:28 on dist-test-slave-6bbx"
server_key: "26d86e8b241e292b19a0d1f11912c006"
server_key_iv: "20194e248aa3e267300f3f8aea6220a8"
server_key_version: "encryptionkey@0"
I20260807 19:56:28.148052 19944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "f2eb89e049d24d9286af3dfe58afb33d"
format_stamp: "Formatted at 2026-08-07 19:56:28 on dist-test-slave-6bbx"
server_key: "26d86e8b241e292b19a0d1f11912c006"
server_key_iv: "20194e248aa3e267300f3f8aea6220a8"
server_key_version: "encryptionkey@0"
I20260807 19:56:28.153191 19944 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 19:56:28.156598 19972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:28.157939 19944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 19:56:28.158108 19944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "f2eb89e049d24d9286af3dfe58afb33d"
format_stamp: "Formatted at 2026-08-07 19:56:28 on dist-test-slave-6bbx"
server_key: "26d86e8b241e292b19a0d1f11912c006"
server_key_iv: "20194e248aa3e267300f3f8aea6220a8"
server_key_version: "encryptionkey@0"
I20260807 19:56:28.158313 19944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:28.164144 19944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:28.164915 19944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:28.165195 19944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:28.183132 19944 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:39527
I20260807 19:56:28.183158 20041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:39527 every 8 connection(s)
I20260807 19:56:28.184590 19944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:56:28.188540 20043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:28.193253 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 19944
I20260807 19:56:28.193444 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:56:28.194094 5910 external_mini_cluster.cc:1428] Setting key 0cf244a10e340301338afbdb3338ea2c
I20260807 19:56:28.200924 20043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d: Bootstrap starting.
I20260807 19:56:28.203785 20047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:28.196118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44816 (local address 127.5.197.190:39527)
0807 19:56:28.197278 (+ 1160us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:28.197292 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:28.197346 (+ 54us) server_negotiation.cc:407] Connection header received
0807 19:56:28.199711 (+ 2365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:28.199740 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:28.200275 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:28.200716 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:28.201745 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:28.201753 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:28.201769 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:28.201788 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:28.201861 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:28.201887 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:28.202091 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:28.202242 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 19:56:28.202497 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":354,"threads_started":1}
I20260807 19:56:28.204983 20043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:28.206074 20043 log.cc:824] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:28.208889 20043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d: No bootstrap required, opened a new log
I20260807 19:56:28.216424 20043 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2eb89e049d24d9286af3dfe58afb33d" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39527 } }
I20260807 19:56:28.216784 20043 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:28.216861 20043 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2eb89e049d24d9286af3dfe58afb33d, State: Initialized, Role: FOLLOWER
I20260807 19:56:28.217406 20043 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2eb89e049d24d9286af3dfe58afb33d" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39527 } }
I20260807 19:56:28.217609 20043 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:56:28.217715 20043 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:56:28.217835 20043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:28.219930 20043 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2eb89e049d24d9286af3dfe58afb33d" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39527 } }
I20260807 19:56:28.220372 20043 leader_election.cc:302] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2eb89e049d24d9286af3dfe58afb33d; no voters:
I20260807 19:56:28.220909 20043 leader_election.cc:288] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:56:28.221038 20049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:56:28.221755 20049 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [term 1 LEADER]: Becoming Leader. State: Replica: f2eb89e049d24d9286af3dfe58afb33d, State: Running, Role: LEADER
I20260807 19:56:28.222295 20049 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2eb89e049d24d9286af3dfe58afb33d" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39527 } }
I20260807 19:56:28.223026 20043 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:56:28.225481 20050 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2eb89e049d24d9286af3dfe58afb33d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2eb89e049d24d9286af3dfe58afb33d" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39527 } } }
I20260807 19:56:28.225554 20051 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2eb89e049d24d9286af3dfe58afb33d. Latest consensus state: current_term: 1 leader_uuid: "f2eb89e049d24d9286af3dfe58afb33d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2eb89e049d24d9286af3dfe58afb33d" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39527 } } }
I20260807 19:56:28.225883 20050 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:28.225952 20051 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:28.228157 20059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:56:28.233513 20059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:56:28.242815 20059 catalog_manager.cc:1347] Generated new cluster ID: c37d59e1433a4bfcb60bf2a2ff9cdcf6
I20260807 19:56:28.242940 20059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:56:28.273689 20059 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:56:28.274111 20059 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:56:28.283941 20059 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2eb89e049d24d9286af3dfe58afb33d: Generated new TSK 0
I20260807 19:56:28.284844 20059 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:56:28.297858 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39527
--builtin_ntp_servers=127.5.197.148:41533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 19:56:28.661237 20081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:28.661590 20081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:28.661725 20081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:28.669268 20081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:28.669384 20081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:28.669531 20081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:56:28.679494 20081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:28.680776 20081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:28.682602 20081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:28.695281 20090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:28.695358 20097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:28.695379 20093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:28.696074 20081 server_base.cc:1034] running on GCE node
I20260807 19:56:28.696632 20081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:28.697512 20081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:28.698740 20081 hybrid_clock.cc:648] HybridClock initialized: now 1786132588698691 us; error 32 us; skew 500 ppm
I20260807 19:56:28.699041 20081 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:28.701264 20081 webserver.cc:460] Webserver started at http://127.5.197.129:39515/ using document root <none> and password file <none>
I20260807 19:56:28.701924 20081 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:28.702028 20081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:28.702381 20081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:28.705214 20081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "c648e115ae5d40a0ac6faa4b642c5413"
format_stamp: "Formatted at 2026-08-07 19:56:28 on dist-test-slave-6bbx"
server_key: "f244ef7c05471496075c51a4fc320d2d"
server_key_iv: "d7c780b4ad8ab197be08aaa31319043b"
server_key_version: "encryptionkey@0"
I20260807 19:56:28.706019 20081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "c648e115ae5d40a0ac6faa4b642c5413"
format_stamp: "Formatted at 2026-08-07 19:56:28 on dist-test-slave-6bbx"
server_key: "f244ef7c05471496075c51a4fc320d2d"
server_key_iv: "d7c780b4ad8ab197be08aaa31319043b"
server_key_version: "encryptionkey@0"
I20260807 19:56:28.711158 20081 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:56:28.714571 20108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:28.715828 20081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:56:28.715976 20081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "c648e115ae5d40a0ac6faa4b642c5413"
format_stamp: "Formatted at 2026-08-07 19:56:28 on dist-test-slave-6bbx"
server_key: "f244ef7c05471496075c51a4fc320d2d"
server_key_iv: "d7c780b4ad8ab197be08aaa31319043b"
server_key_version: "encryptionkey@0"
I20260807 19:56:28.716176 20081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:28.721499 20081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:28.722244 20081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:28.722478 20081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:28.723404 20081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:28.724965 20081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:28.725062 20081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:28.725170 20081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:28.725242 20081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:28.755541 20081 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:46235
I20260807 19:56:28.755592 20292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:46235 every 8 connection(s)
I20260807 19:56:28.756798 20081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:56:28.763890 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 20081
I20260807 19:56:28.764083 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:56:28.764714 5910 external_mini_cluster.cc:1428] Setting key d86ec5562f6d3ebc2d767b8ed6182707
I20260807 19:56:28.764846 20296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:28.759215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58817 (local address 127.5.197.190:39527)
0807 19:56:28.759638 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:28.759643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:28.760755 (+ 1112us) server_negotiation.cc:407] Connection header received
0807 19:56:28.762488 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:28.762493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:28.762564 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:28.762661 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:28.764041 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:28.764048 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:28.764053 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:28.764070 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:28.764114 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:28.764130 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:28.764263 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:28.764469 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 19:56:28.764535 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":221,"threads_started":1}
I20260807 19:56:28.765790 20300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:28.759732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39527 (local address 127.5.197.129:58817)
0807 19:56:28.760590 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:28.760632 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:28.762229 (+ 1597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:28.762916 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:28.762924 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:28.763008 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:28.763637 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:56:28.763640 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:28.763735 (+ 95us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:56:28.763850 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:28.764256 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:28.764269 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:28.764277 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 19:56:28.764544 (+ 267us) client_negotiation.cc:240] Negotiation successful
0807 19:56:28.764779 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":252,"threads_started":1}
I20260807 19:56:28.767139 20293 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39527
I20260807 19:56:28.767409 20293 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:28.767474 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39527
--builtin_ntp_servers=127.5.197.148:41533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 19:56:28.768015 20293 heartbeater.cc:511] Master 127.5.197.190:39527 requested a full tablet report, sending...
I20260807 19:56:28.769852 19999 ts_manager.cc:194] Registered new tserver with Master: c648e115ae5d40a0ac6faa4b642c5413 (127.5.197.129:46235)
W20260807 19:56:29.104503 20304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:29.104817 20304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:29.104918 20304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:29.112355 20304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:29.112476 20304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:29.112586 20304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:56:29.121959 20304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:29.123363 20304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:29.125263 20304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:29.138325 20311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:29.138384 20312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:29.138288 20317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:29.139473 20304 server_base.cc:1034] running on GCE node
I20260807 19:56:29.140116 20304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:29.141028 20304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:29.142225 20304 hybrid_clock.cc:648] HybridClock initialized: now 1786132589142163 us; error 52 us; skew 500 ppm
I20260807 19:56:29.142518 20304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:29.144856 20304 webserver.cc:460] Webserver started at http://127.5.197.130:32795/ using document root <none> and password file <none>
I20260807 19:56:29.145570 20304 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:29.145668 20304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:29.145968 20304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:29.148901 20304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "4e74ecc8a65a4af09da61c15ebc080d2"
format_stamp: "Formatted at 2026-08-07 19:56:29 on dist-test-slave-6bbx"
server_key: "029ac2d98f5e3094c40fb2dfe4b6c55f"
server_key_iv: "438e5ab9051a69fbf5109dedc96282fb"
server_key_version: "encryptionkey@0"
I20260807 19:56:29.149649 20304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "4e74ecc8a65a4af09da61c15ebc080d2"
format_stamp: "Formatted at 2026-08-07 19:56:29 on dist-test-slave-6bbx"
server_key: "029ac2d98f5e3094c40fb2dfe4b6c55f"
server_key_iv: "438e5ab9051a69fbf5109dedc96282fb"
server_key_version: "encryptionkey@0"
I20260807 19:56:29.154788 20304 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:56:29.158319 20324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:29.159619 20304 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:56:29.159801 20304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "4e74ecc8a65a4af09da61c15ebc080d2"
format_stamp: "Formatted at 2026-08-07 19:56:29 on dist-test-slave-6bbx"
server_key: "029ac2d98f5e3094c40fb2dfe4b6c55f"
server_key_iv: "438e5ab9051a69fbf5109dedc96282fb"
server_key_version: "encryptionkey@0"
I20260807 19:56:29.160006 20304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:29.165711 20304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:29.166476 20304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:29.166718 20304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:29.167619 20304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:29.169005 20304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:29.169100 20304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:29.169209 20304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:29.169277 20304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:29.199914 20304 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:40311
I20260807 19:56:29.199997 20503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:40311 every 8 connection(s)
I20260807 19:56:29.201478 20304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:56:29.205988 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 20304
I20260807 19:56:29.206161 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:56:29.206750 5910 external_mini_cluster.cc:1428] Setting key 28b0e8f3a5741abeee2598f5ce9cef75
I20260807 19:56:29.209923 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39527
--builtin_ntp_servers=127.5.197.148:41533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 19:56:29.210345 20296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:29.204137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:58293 (local address 127.5.197.190:39527)
0807 19:56:29.204309 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:29.204314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:29.205905 (+ 1591us) server_negotiation.cc:407] Connection header received
0807 19:56:29.208129 (+ 2224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:29.208134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:29.208211 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:29.208306 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:29.209650 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:29.209654 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:29.209658 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:29.209673 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:29.209703 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:29.209714 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:29.209801 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:29.210018 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 19:56:29.210081 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:56:29.211516 20507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:29.204764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39527 (local address 127.5.197.130:58293)
0807 19:56:29.205724 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:29.205773 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:29.207880 (+ 2107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:29.208521 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:29.208531 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:29.208649 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:29.209320 (+ 671us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:56:29.209323 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:29.209371 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:56:29.209481 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:29.209810 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:29.209821 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:29.209829 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 19:56:29.210116 (+ 287us) client_negotiation.cc:240] Negotiation successful
0807 19:56:29.210401 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":275,"threads_started":1}
I20260807 19:56:29.212819 20505 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39527
I20260807 19:56:29.213099 20505 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:29.213665 20505 heartbeater.cc:511] Master 127.5.197.190:39527 requested a full tablet report, sending...
I20260807 19:56:29.214944 19999 ts_manager.cc:194] Registered new tserver with Master: 4e74ecc8a65a4af09da61c15ebc080d2 (127.5.197.130:40311)
W20260807 19:56:29.549588 20510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:29.549909 20510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:29.550052 20510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:29.557296 20510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:29.557416 20510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:29.557565 20510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:56:29.567137 20510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:41533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:29.568590 20510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:29.570433 20510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:29.583818 20518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:29.583781 20524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:29.583850 20519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:29.584610 20510 server_base.cc:1034] running on GCE node
I20260807 19:56:29.585258 20510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:29.586215 20510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:29.587427 20510 hybrid_clock.cc:648] HybridClock initialized: now 1786132589587369 us; error 52 us; skew 500 ppm
I20260807 19:56:29.587779 20510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:56:29.590091 20510 webserver.cc:460] Webserver started at http://127.5.197.131:34247/ using document root <none> and password file <none>
I20260807 19:56:29.590806 20510 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:29.590914 20510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:29.591264 20510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:29.594246 20510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "cee755feed9c4d479d6900be44db9303"
format_stamp: "Formatted at 2026-08-07 19:56:29 on dist-test-slave-6bbx"
server_key: "0325a21947a94521e7992d88e047750f"
server_key_iv: "14c8b86a9a16770502d5e2e9b28783b7"
server_key_version: "encryptionkey@0"
I20260807 19:56:29.595054 20510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "cee755feed9c4d479d6900be44db9303"
format_stamp: "Formatted at 2026-08-07 19:56:29 on dist-test-slave-6bbx"
server_key: "0325a21947a94521e7992d88e047750f"
server_key_iv: "14c8b86a9a16770502d5e2e9b28783b7"
server_key_version: "encryptionkey@0"
I20260807 19:56:29.600303 20510 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 19:56:29.603783 20534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:29.605142 20510 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:56:29.605322 20510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "cee755feed9c4d479d6900be44db9303"
format_stamp: "Formatted at 2026-08-07 19:56:29 on dist-test-slave-6bbx"
server_key: "0325a21947a94521e7992d88e047750f"
server_key_iv: "14c8b86a9a16770502d5e2e9b28783b7"
server_key_version: "encryptionkey@0"
I20260807 19:56:29.605537 20510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:29.611301 20510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:29.612183 20510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:29.612452 20510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:29.613374 20510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:29.614794 20510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:29.614894 20510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:29.615005 20510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:29.615075 20510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:29.645581 20510 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:46025
I20260807 19:56:29.645638 20724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:46025 every 8 connection(s)
I20260807 19:56:29.646920 20510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:56:29.650194 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 20510
I20260807 19:56:29.650352 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:56:29.650805 5910 external_mini_cluster.cc:1428] Setting key 290f88336d836f0bcdb307a2ca6d5f25
I20260807 19:56:29.655187 20296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:29.649444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:38665 (local address 127.5.197.190:39527)
0807 19:56:29.649613 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:29.649618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:29.651169 (+ 1551us) server_negotiation.cc:407] Connection header received
0807 19:56:29.653188 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:29.653192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:29.653264 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:29.653342 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:29.654637 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:29.654642 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:29.654645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:29.654660 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:29.654691 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:29.654703 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:29.654790 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:29.654932 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 19:56:29.654979 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:56:29.656142 20729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:29.649944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39527 (local address 127.5.197.131:38665)
0807 19:56:29.650989 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:29.651033 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:29.652930 (+ 1897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:29.653614 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:29.653626 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:29.653732 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:29.654364 (+ 632us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:56:29.654367 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:29.654405 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:56:29.654492 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:29.654776 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:29.654782 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:29.654786 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 19:56:29.654993 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 19:56:29.655181 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":319,"threads_started":1}
I20260807 19:56:29.657315 20726 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39527
I20260807 19:56:29.657588 20726 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:29.658154 20726 heartbeater.cc:511] Master 127.5.197.190:39527 requested a full tablet report, sending...
I20260807 19:56:29.659425 19999 ts_manager.cc:194] Registered new tserver with Master: cee755feed9c4d479d6900be44db9303 (127.5.197.131:46025)
I20260807 19:56:29.665948 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 19:56:29.671852 20296 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:56:29.670325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44820 (local address 127.5.197.190:39527)
0807 19:56:29.670485 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:29.670489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:29.670980 (+ 491us) server_negotiation.cc:407] Connection header received
0807 19:56:29.671136 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:29.671140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:29.671193 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:29.671272 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:29.671619 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44820: BlockingRecv error: recv got EOF from 127.0.0.1:44820 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:56:29.672530 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 20081
I20260807 19:56:29.676224 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:29.673538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56446 (local address 127.5.197.129:46235)
0807 19:56:29.674064 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:29.674071 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:29.674097 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:56:29.674158 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:29.674164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:29.674380 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:29.674539 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:29.675465 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:29.675471 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:29.675483 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:29.675503 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:29.675544 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:29.675558 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:29.675706 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:29.675837 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 19:56:29.675944 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":256,"threads_started":1}
I20260807 19:56:29.677384 20287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:29.762882 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 20081
I20260807 19:56:29.785991 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 20304
I20260807 19:56:29.789810 20742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:29.786919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40158 (local address 127.5.197.130:40311)
0807 19:56:29.787474 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:29.787490 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:29.787519 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:56:29.787586 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:29.787593 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:29.787894 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:29.788060 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:29.789062 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:29.789068 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:29.789080 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:29.789099 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:29.789141 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:29.789156 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:29.789287 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:29.789416 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 19:56:29.789523 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":266,"threads_started":1}
I20260807 19:56:29.791106 20498 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:29.872105 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 20304
I20260807 19:56:29.895632 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 20510
I20260807 19:56:29.899863 20745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:29.896683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58072 (local address 127.5.197.131:46025)
0807 19:56:29.897407 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:29.897414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:29.897446 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:56:29.897514 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:29.897521 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:29.897740 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:29.897893 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:29.899051 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:29.899058 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:29.899069 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:56:29.899085 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:29.899124 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:56:29.899138 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:29.899308 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:29.899389 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 19:56:29.899491 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":346,"threads_started":1}
I20260807 19:56:29.901088 20720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:29.981592 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 20510
I20260807 19:56:30.005604 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 19944
I20260807 19:56:30.006778 20035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:30.109253 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 19944
2026-08-07T19:56:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2444 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:56:30 dist-test-slave-6bbx krb5kdc[20752](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:56:30 dist-test-slave-6bbx krb5kdc[20752](info): set up 2 sockets
Aug 07 19:56:30 dist-test-slave-6bbx krb5kdc[20752](info): commencing operation
krb5kdc: starting...
W20260807 19:56:31.323290 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:56:31 dist-test-slave-6bbx krb5kdc[20752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:56:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:56:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:56:31.631593 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:44057
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:44057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:31.976576 20775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:31.976897 20775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:31.976996 20775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:31.984228 20775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:56:31.984344 20775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:31.984398 20775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:31.984455 20775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:56:31.984499 20775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:56:31.994374 20775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:44057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:44057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:31.995752 20775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:31.997020 20775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:32.008731 20784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:32.008649 20786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:32.008759 20782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:32.013456 20775 server_base.cc:1034] running on GCE node
I20260807 19:56:32.014326 20775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:32.015920 20775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:32.017172 20775 hybrid_clock.cc:648] HybridClock initialized: now 1786132592017110 us; error 36 us; skew 500 ppm
I20260807 19:56:32.017552 20775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:32 dist-test-slave-6bbx krb5kdc[20752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132592, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:32.020844 20775 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:56:32.022488 20775 webserver.cc:460] Webserver started at http://127.5.197.190:39523/ using document root <none> and password file <none>
I20260807 19:56:32.023406 20775 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:32.023536 20775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:32.023907 20775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:32.027010 20775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "15a9bc77be3643ec9ea90acbb71b5af0"
format_stamp: "Formatted at 2026-08-07 19:56:32 on dist-test-slave-6bbx"
server_key: "881578d9fd37c8dbfd9d6f74ccdf604c"
server_key_iv: "2c2f84ef4e0f62ccaf9e62b8f5d9f984"
server_key_version: "encryptionkey@0"
I20260807 19:56:32.027849 20775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "15a9bc77be3643ec9ea90acbb71b5af0"
format_stamp: "Formatted at 2026-08-07 19:56:32 on dist-test-slave-6bbx"
server_key: "881578d9fd37c8dbfd9d6f74ccdf604c"
server_key_iv: "2c2f84ef4e0f62ccaf9e62b8f5d9f984"
server_key_version: "encryptionkey@0"
I20260807 19:56:32.033072 20775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:56:32.036610 20799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:32.038065 20775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:56:32.038226 20775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "15a9bc77be3643ec9ea90acbb71b5af0"
format_stamp: "Formatted at 2026-08-07 19:56:32 on dist-test-slave-6bbx"
server_key: "881578d9fd37c8dbfd9d6f74ccdf604c"
server_key_iv: "2c2f84ef4e0f62ccaf9e62b8f5d9f984"
server_key_version: "encryptionkey@0"
I20260807 19:56:32.038409 20775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:32.059388 20775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:32.063925 20775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:32.064174 20775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:32.082126 20775 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:44057
I20260807 19:56:32.082176 20885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:44057 every 8 connection(s)
I20260807 19:56:32.083530 20775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:56:32.087260 20886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:32.091220 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 20775
I20260807 19:56:32.091411 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:56:32.092119 5910 external_mini_cluster.cc:1428] Setting key a23f52f3d71de2f1d7b7455ee6f54a66
I20260807 19:56:32.098381 20886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0: Bootstrap starting.
I20260807 19:56:32.102221 20886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:32.103421 20886 log.cc:824] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:32.106801 20886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0: No bootstrap required, opened a new log
Aug 07 19:56:32 dist-test-slave-6bbx krb5kdc[20752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:32.117157 20892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:32.094012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54336 (local address 127.5.197.190:44057)
0807 19:56:32.094786 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:32.094798 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:32.094840 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:56:32.096816 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:32.096842 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:32.097243 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:32.097595 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:32.099563 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:32.100978 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:32.102803 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:32.103503 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:32.103660 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:32.108305 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:32.108318 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:32.108338 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:32.108393 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:32.112436 (+ 4043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:32.113126 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:32.113139 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:32.113148 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:32.113366 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:32.113703 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:32.113709 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:32.113712 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:32.114549 (+ 837us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:32.114869 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:32.115222 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 19:56:32.115751 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":349,"threads_started":1}
I20260807 19:56:32.117295 20886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 44057 } }
I20260807 19:56:32.117758 20886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:32.117888 20886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a9bc77be3643ec9ea90acbb71b5af0, State: Initialized, Role: FOLLOWER
I20260807 19:56:32.118466 20886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 44057 } }
I20260807 19:56:32.118759 20886 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:56:32.118906 20886 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:56:32.119095 20886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:32.121755 20886 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 44057 } }
I20260807 19:56:32.122221 20886 leader_election.cc:302] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15a9bc77be3643ec9ea90acbb71b5af0; no voters:
I20260807 19:56:32.122743 20886 leader_election.cc:288] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:56:32.122895 20897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:56:32.123499 20897 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [term 1 LEADER]: Becoming Leader. State: Replica: 15a9bc77be3643ec9ea90acbb71b5af0, State: Running, Role: LEADER
I20260807 19:56:32.124054 20897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 44057 } }
I20260807 19:56:32.124739 20886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:56:32.126555 20898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 44057 } } }
I20260807 19:56:32.127068 20898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:32.127401 20901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15a9bc77be3643ec9ea90acbb71b5af0. Latest consensus state: current_term: 1 leader_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15a9bc77be3643ec9ea90acbb71b5af0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 44057 } } }
I20260807 19:56:32.127748 20901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0 [sys.catalog]: This master's current role is: LEADER
I20260807 19:56:32.129360 20906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:56:32.134464 20906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:56:32.144589 20906 catalog_manager.cc:1347] Generated new cluster ID: d2c4a26d413b4ad3a698933b9a0242d3
I20260807 19:56:32.144732 20906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:56:32.158372 20906 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:56:32.159651 20906 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:56:32.166277 20906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0: Generated new TSK 0
I20260807 19:56:32.167145 20906 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:56:32.243623 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:44057
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:32.581307 20934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:32.581580 20934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:32.581676 20934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:32.588681 20934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:32.588776 20934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:32.588883 20934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:56:32.598047 20934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:44057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:32.599170 20934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:32.600458 20934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:32.613662 20946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:32.613704 20949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:32.613662 20955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:32.614641 20934 server_base.cc:1034] running on GCE node
I20260807 19:56:32.615181 20934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:32.616132 20934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:32.617340 20934 hybrid_clock.cc:648] HybridClock initialized: now 1786132592617290 us; error 43 us; skew 500 ppm
I20260807 19:56:32.617643 20934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:32 dist-test-slave-6bbx krb5kdc[20752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132592, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:32.620738 20934 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:56:32.622167 20934 webserver.cc:460] Webserver started at http://127.5.197.129:43307/ using document root <none> and password file <none>
I20260807 19:56:32.622869 20934 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:32.622977 20934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:32.623255 20934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:32.626142 20934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "ec2187960d53446dadbd90e4a0c20cf6"
format_stamp: "Formatted at 2026-08-07 19:56:32 on dist-test-slave-6bbx"
server_key: "beb3d7e8360b38f5ad05608caa57421a"
server_key_iv: "2261b86e5a931e59c70a0f27f8c528af"
server_key_version: "encryptionkey@0"
I20260807 19:56:32.626864 20934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "ec2187960d53446dadbd90e4a0c20cf6"
format_stamp: "Formatted at 2026-08-07 19:56:32 on dist-test-slave-6bbx"
server_key: "beb3d7e8360b38f5ad05608caa57421a"
server_key_iv: "2261b86e5a931e59c70a0f27f8c528af"
server_key_version: "encryptionkey@0"
I20260807 19:56:32.631899 20934 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:56:32.635309 20965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:32.636672 20934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:56:32.636802 20934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "ec2187960d53446dadbd90e4a0c20cf6"
format_stamp: "Formatted at 2026-08-07 19:56:32 on dist-test-slave-6bbx"
server_key: "beb3d7e8360b38f5ad05608caa57421a"
server_key_iv: "2261b86e5a931e59c70a0f27f8c528af"
server_key_version: "encryptionkey@0"
I20260807 19:56:32.636963 20934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:32.661412 20934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:32.665712 20934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:32.666041 20934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:32.667007 20934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:32.668475 20934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:32.668567 20934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:32.668659 20934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:32.668704 20934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:32.702826 20934 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:46435
I20260807 19:56:32.702883 21147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:46435 every 8 connection(s)
I20260807 19:56:32.704176 20934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:56:32.714612 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 20934
I20260807 19:56:32.714839 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:56:32.715646 5910 external_mini_cluster.cc:1428] Setting key 9499fdc21c2112df872f4aa6807d6830
Aug 07 19:56:32 dist-test-slave-6bbx krb5kdc[20752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132592, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:32.725513 21151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:32.706800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:54885 (local address 127.5.197.190:44057)
0807 19:56:32.707295 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:32.707302 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:32.708319 (+ 1017us) server_negotiation.cc:407] Connection header received
0807 19:56:32.710149 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:32.710154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:32.710237 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:32.710336 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:32.711970 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:32.712744 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:32.714423 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:32.715028 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:32.715171 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:32.718744 (+ 3573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:32.718751 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:32.718755 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:32.718795 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:32.721875 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:32.722699 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:32.722705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:32.722708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:32.722855 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:32.723404 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:32.723409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:32.723412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:32.723882 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:32.724025 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:32.724964 (+ 939us) server_negotiation.cc:299] Negotiation successful
0807 19:56:32.725175 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":229,"threads_started":1}
I20260807 19:56:32.726804 21153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:32.707350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:44057 (local address 127.5.197.129:54885)
0807 19:56:32.708132 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:32.708180 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:32.709871 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:32.710564 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:32.710573 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:32.711118 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:32.711796 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:32.711816 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:32.712896 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:32.712900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:32.714270 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:32.714283 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:32.715273 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:32.715279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:32.715480 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:32.716096 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:32.716120 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:32.718499 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:32.722031 (+ 3532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:32.722038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:32.722052 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:32.722558 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:32.722956 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:32.722961 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:32.722965 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:32.723279 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:32.724037 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:32.724046 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:32.724494 (+ 448us) client_negotiation.cc:769] Sending connection context
0807 19:56:32.724826 (+ 332us) client_negotiation.cc:240] Negotiation successful
0807 19:56:32.725391 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":322,"threads_started":1}
I20260807 19:56:32.728480 21148 heartbeater.cc:347] Connected to a master server at 127.5.197.190:44057
I20260807 19:56:32.728798 21148 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:32.729547 21148 heartbeater.cc:511] Master 127.5.197.190:44057 requested a full tablet report, sending...
I20260807 19:56:32.731644 20828 ts_manager.cc:194] Registered new tserver with Master: ec2187960d53446dadbd90e4a0c20cf6 (127.5.197.129:46435)
I20260807 19:56:32.733677 20828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:54885
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:56:32.780963 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:44057
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:33.124878 21156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:33.125161 21156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:33.125293 21156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:33.132534 21156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:33.132647 21156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:33.132802 21156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:56:33.142853 21156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:44057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:33.144212 21156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:33.145532 21156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:33.158454 21164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:33.158414 21170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:33.158479 21166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:33.159376 21156 server_base.cc:1034] running on GCE node
I20260807 19:56:33.160061 21156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:33.161033 21156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:33.162232 21156 hybrid_clock.cc:648] HybridClock initialized: now 1786132593162181 us; error 42 us; skew 500 ppm
I20260807 19:56:33.162556 21156 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:33 dist-test-slave-6bbx krb5kdc[20752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132593, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:33.165807 21156 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:56:33.167428 21156 webserver.cc:460] Webserver started at http://127.5.197.130:33509/ using document root <none> and password file <none>
I20260807 19:56:33.168175 21156 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:33.168299 21156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:33.168612 21156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:33.171620 21156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "be6d5c3e2497416db0cf57ea32be7767"
format_stamp: "Formatted at 2026-08-07 19:56:33 on dist-test-slave-6bbx"
server_key: "472983af71e8f8c202cf84085fd1fc0d"
server_key_iv: "1531d68474661e560887a17952ed4322"
server_key_version: "encryptionkey@0"
I20260807 19:56:33.172468 21156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "be6d5c3e2497416db0cf57ea32be7767"
format_stamp: "Formatted at 2026-08-07 19:56:33 on dist-test-slave-6bbx"
server_key: "472983af71e8f8c202cf84085fd1fc0d"
server_key_iv: "1531d68474661e560887a17952ed4322"
server_key_version: "encryptionkey@0"
I20260807 19:56:33.177850 21156 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 19:56:33.181442 21183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:33.182869 21156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:56:33.183034 21156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "be6d5c3e2497416db0cf57ea32be7767"
format_stamp: "Formatted at 2026-08-07 19:56:33 on dist-test-slave-6bbx"
server_key: "472983af71e8f8c202cf84085fd1fc0d"
server_key_iv: "1531d68474661e560887a17952ed4322"
server_key_version: "encryptionkey@0"
I20260807 19:56:33.183239 21156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:33.196206 21156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:33.200244 21156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:33.200529 21156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:33.201479 21156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:33.202862 21156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:33.202943 21156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:33.203063 21156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:33.203120 21156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:33.235242 21156 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:45791
I20260807 19:56:33.235314 21368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:45791 every 8 connection(s)
I20260807 19:56:33.236730 21156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:56:33.241246 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 21156
I20260807 19:56:33.241436 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:56:33.241911 5910 external_mini_cluster.cc:1428] Setting key 6d03a9855bc2d2e828e5ae2275fbd627
Aug 07 19:56:33 dist-test-slave-6bbx krb5kdc[20752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132593, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:33.257494 21371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.239432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:50499 (local address 127.5.197.190:44057)
0807 19:56:33.239904 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:33.239909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:33.240841 (+ 932us) server_negotiation.cc:407] Connection header received
0807 19:56:33.243043 (+ 2202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:33.243049 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:33.243134 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:33.243245 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:33.245014 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.245763 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.247326 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.247802 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.247918 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.251481 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:33.251486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:33.251489 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:33.251524 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:33.254138 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:33.255027 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:33.255031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:33.255034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:33.255177 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:33.255631 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:33.255634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:33.255637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:33.255967 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:33.256110 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:33.257005 (+ 895us) server_negotiation.cc:299] Negotiation successful
0807 19:56:33.257211 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":255,"threads_started":1}
I20260807 19:56:33.258961 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.239884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:44057 (local address 127.5.197.130:50499)
0807 19:56:33.240645 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:33.240687 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:33.242722 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:33.243500 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:33.243509 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:33.244189 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:33.244845 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.244865 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.245919 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.245923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.247179 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.247193 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.248032 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.248040 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.248262 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.248967 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:33.248990 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:33.251248 (+ 2258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:33.254393 (+ 3145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:33.254400 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:33.254415 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:33.254881 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:33.255301 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:33.255307 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:33.255310 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:33.255517 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:33.256101 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:33.256109 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:33.256531 (+ 422us) client_negotiation.cc:769] Sending connection context
0807 19:56:33.256900 (+ 369us) client_negotiation.cc:240] Negotiation successful
0807 19:56:33.257515 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":311,"threads_started":1}
I20260807 19:56:33.260650 21369 heartbeater.cc:347] Connected to a master server at 127.5.197.190:44057
I20260807 19:56:33.261022 21369 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:33.261951 21369 heartbeater.cc:511] Master 127.5.197.190:44057 requested a full tablet report, sending...
I20260807 19:56:33.263792 20828 ts_manager.cc:194] Registered new tserver with Master: be6d5c3e2497416db0cf57ea32be7767 (127.5.197.130:45791)
I20260807 19:56:33.264638 20828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:50499
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:56:33.311245 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:44057
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:34703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:56:33.649967 21378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:56:33.650249 21378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:56:33.650385 21378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:56:33.657722 21378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:56:33.657856 21378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:56:33.658010 21378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:56:33.668002 21378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:34703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:44057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:56:33.669351 21378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:56:33.670697 21378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:56:33.683909 21387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:33.683876 21386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:56:33.683938 21391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:56:33.684916 21378 server_base.cc:1034] running on GCE node
I20260807 19:56:33.685497 21378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:56:33.686417 21378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:56:33.687623 21378 hybrid_clock.cc:648] HybridClock initialized: now 1786132593687547 us; error 68 us; skew 500 ppm
I20260807 19:56:33.687987 21378 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:56:33 dist-test-slave-6bbx krb5kdc[20752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132593, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:56:33.691033 21378 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:56:33.692544 21378 webserver.cc:460] Webserver started at http://127.5.197.131:37505/ using document root <none> and password file <none>
I20260807 19:56:33.693244 21378 fs_manager.cc:359] Metadata directory not provided
I20260807 19:56:33.693454 21378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:56:33.693802 21378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:56:33.697022 21378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "f335fc3e546648b5a58cf1f36cd75521"
format_stamp: "Formatted at 2026-08-07 19:56:33 on dist-test-slave-6bbx"
server_key: "3e102ff46920afd565d641a942ad5153"
server_key_iv: "b9074982c7dcd81984eec1723002b922"
server_key_version: "encryptionkey@0"
I20260807 19:56:33.698064 21378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "f335fc3e546648b5a58cf1f36cd75521"
format_stamp: "Formatted at 2026-08-07 19:56:33 on dist-test-slave-6bbx"
server_key: "3e102ff46920afd565d641a942ad5153"
server_key_iv: "b9074982c7dcd81984eec1723002b922"
server_key_version: "encryptionkey@0"
I20260807 19:56:33.703790 21378 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 19:56:33.708266 21407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:33.709573 21378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 19:56:33.709755 21378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "f335fc3e546648b5a58cf1f36cd75521"
format_stamp: "Formatted at 2026-08-07 19:56:33 on dist-test-slave-6bbx"
server_key: "3e102ff46920afd565d641a942ad5153"
server_key_iv: "b9074982c7dcd81984eec1723002b922"
server_key_version: "encryptionkey@0"
I20260807 19:56:33.710009 21378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:56:33.737403 21148 heartbeater.cc:503] Master 127.5.197.190:44057 was elected leader, sending a full tablet report...
I20260807 19:56:33.738576 21378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:56:33.743603 21378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:56:33.743947 21378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:56:33.744956 21378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:56:33.746493 21378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:56:33.746575 21378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:33.746701 21378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:56:33.746755 21378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:56:33.778901 21378 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39829
I20260807 19:56:33.778940 21599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39829 every 8 connection(s)
I20260807 19:56:33.780265 21378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:56:33.782405 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 21378
I20260807 19:56:33.782559 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:56:33.783113 5910 external_mini_cluster.cc:1428] Setting key 143a05de430a85ff4ffc6b8368877b79
Aug 07 19:56:33 dist-test-slave-6bbx krb5kdc[20752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132593, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:56:33.801338 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.782937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:43503 (local address 127.5.197.190:44057)
0807 19:56:33.783431 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:33.783438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:33.784609 (+ 1171us) server_negotiation.cc:407] Connection header received
0807 19:56:33.786729 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:33.786734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:33.786873 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:33.786979 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:33.788607 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.789385 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.790895 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.791289 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.791409 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.794990 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:33.794995 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:33.794998 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:33.795042 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:33.797967 (+ 2925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:33.798896 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:33.798901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:33.798904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:33.799041 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:33.799508 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:33.799512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:33.799514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:33.799830 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:33.799978 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:33.800720 (+ 742us) server_negotiation.cc:299] Negotiation successful
0807 19:56:33.800954 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":228,"threads_started":1}
I20260807 19:56:33.802368 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.783443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:44057 (local address 127.5.197.131:43503)
0807 19:56:33.784331 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:33.784374 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:33.786443 (+ 2069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:33.787232 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:33.787241 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:33.787811 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:56:33.788449 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.788468 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.789532 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.789536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.790758 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.790771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.791511 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.791518 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.791798 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.792443 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:56:33.792465 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:56:33.794745 (+ 2280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:56:33.798109 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:33.798118 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:33.798137 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:33.798764 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:33.799155 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:56:33.799160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:56:33.799165 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:56:33.799384 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:56:33.799959 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:56:33.799968 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:56:33.800336 (+ 368us) client_negotiation.cc:769] Sending connection context
0807 19:56:33.800583 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 19:56:33.801170 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":373,"threads_started":1}
I20260807 19:56:33.803885 21600 heartbeater.cc:347] Connected to a master server at 127.5.197.190:44057
I20260807 19:56:33.804173 21600 heartbeater.cc:464] Registering TS with master...
I20260807 19:56:33.804906 21600 heartbeater.cc:511] Master 127.5.197.190:44057 requested a full tablet report, sending...
I20260807 19:56:33.806499 20828 ts_manager.cc:194] Registered new tserver with Master: f335fc3e546648b5a58cf1f36cd75521 (127.5.197.131:39829)
I20260807 19:56:33.807348 20828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:43503
I20260807 19:56:33.811244 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:56:33.828583 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.815926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54350 (local address 127.5.197.190:44057)
0807 19:56:33.816087 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:33.816092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:33.816520 (+ 428us) server_negotiation.cc:407] Connection header received
0807 19:56:33.816676 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:33.816680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:33.816746 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:33.816826 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:33.818276 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.819074 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.820338 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.820761 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.820851 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.823143 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:33.823150 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:33.823154 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:33.823188 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:33.825922 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:33.826592 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:33.826596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:33.826599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:33.826721 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:33.827096 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:33.827101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:33.827104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:33.827441 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:33.827702 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:33.828049 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 19:56:33.828273 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:56:33.832717 20828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54350:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:56:33.839902 20828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:56:33.878501 21628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.854306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35774 (local address 127.5.197.129:46435)
0807 19:56:33.869448 (+ 15142us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:33.869459 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:33.869496 (+ 37us) server_negotiation.cc:407] Connection header received
0807 19:56:33.870987 (+ 1491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:33.870997 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:33.871236 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:33.871486 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:56:33.872175 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.873724 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.875950 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.877395 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.877518 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.877746 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:33.877992 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 19:56:33.878161 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14939,"thread_start_us":14780,"threads_started":1}
I20260807 19:56:33.878564 21626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.853532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:46435 (local address 127.0.0.1:35774)
0807 19:56:33.863875 (+ 10343us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:33.863894 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:33.864015 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:33.871442 (+ 7427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:33.871446 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:33.871471 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:56:33.871942 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.871957 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.873888 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.873894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.875755 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.875770 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.877610 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.877616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.877800 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.877833 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:56:33.877902 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 19:56:33.878043 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10230,"mutex_wait_us":47,"thread_start_us":10074,"threads_started":1}
I20260807 19:56:33.879119 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.856399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39829 (local address 127.0.0.1:44898)
0807 19:56:33.871093 (+ 14694us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:33.871108 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:33.871235 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:33.871873 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:33.871877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:33.871907 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:56:33.872269 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.872282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.874152 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.874158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.876180 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.876193 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.878247 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.878253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.878453 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.878485 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:56:33.878583 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 19:56:33.878715 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14566,"mutex_wait_us":1,"thread_start_us":5641,"threads_started":1}
I20260807 19:56:33.879128 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.853601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35350 (local address 127.5.197.130:45791)
0807 19:56:33.869832 (+ 16231us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:33.869841 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:33.869888 (+ 47us) server_negotiation.cc:407] Connection header received
0807 19:56:33.869999 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:33.870008 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:33.870319 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:33.870564 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:56:33.871730 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.873022 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.875367 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.876905 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.877052 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.877262 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:33.878654 (+ 1392us) server_negotiation.cc:299] Negotiation successful
0807 19:56:33.878823 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16043,"thread_start_us":17149,"threads_started":1}
I20260807 19:56:33.879755 21630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.853372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:45791 (local address 127.0.0.1:35350)
0807 19:56:33.862476 (+ 9104us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:33.862517 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:33.862714 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:33.870902 (+ 8188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:33.870910 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:33.870975 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:56:33.871451 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.871467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.873153 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.873158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.875197 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:33.875214 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.877132 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.877139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:33.877332 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.877398 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 19:56:33.877540 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 19:56:33.879385 (+ 1845us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8823,"mutex_wait_us":25,"thread_start_us":17447,"threads_started":1}
I20260807 19:56:33.879922 21631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:33.857085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44898 (local address 127.5.197.131:39829)
0807 19:56:33.870436 (+ 13351us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:33.870446 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:33.871232 (+ 786us) server_negotiation.cc:407] Connection header received
0807 19:56:33.871392 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:33.871399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:33.871612 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:33.871866 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:56:33.872463 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.873996 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.876366 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:33.877694 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:33.877799 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:33.878050 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:33.879358 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0807 19:56:33.879532 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13133,"thread_start_us":13359,"threads_started":1}
I20260807 19:56:33.883020 21264 tablet_service.cc:1467] Processing CreateTablet for tablet 9acecd5b2ee74a4ebd9b810287c7afac (DEFAULT_TABLE table=test-table [id=6d32eae0369a44f3b5c4cc54e5eff6af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:56:33.883075 21043 tablet_service.cc:1467] Processing CreateTablet for tablet 9acecd5b2ee74a4ebd9b810287c7afac (DEFAULT_TABLE table=test-table [id=6d32eae0369a44f3b5c4cc54e5eff6af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:56:33.883286 21487 tablet_service.cc:1467] Processing CreateTablet for tablet 9acecd5b2ee74a4ebd9b810287c7afac (DEFAULT_TABLE table=test-table [id=6d32eae0369a44f3b5c4cc54e5eff6af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:56:33.884543 21264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9acecd5b2ee74a4ebd9b810287c7afac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:33.884603 21487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9acecd5b2ee74a4ebd9b810287c7afac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:33.884594 21043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9acecd5b2ee74a4ebd9b810287c7afac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:56:33.895939 21632 tablet_bootstrap.cc:492] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Bootstrap starting.
I20260807 19:56:33.898977 21635 tablet_bootstrap.cc:492] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Bootstrap starting.
I20260807 19:56:33.899587 21632 tablet_bootstrap.cc:654] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:33.899813 21634 tablet_bootstrap.cc:492] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Bootstrap starting.
I20260807 19:56:33.900944 21632 log.cc:824] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:33.903358 21634 tablet_bootstrap.cc:654] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:33.904060 21632 tablet_bootstrap.cc:492] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: No bootstrap required, opened a new log
I20260807 19:56:33.904320 21632 ts_tablet_manager.cc:1397] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260807 19:56:33.904681 21634 log.cc:824] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:33.905121 21635 tablet_bootstrap.cc:654] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Neither blocks nor log segments found. Creating new log.
I20260807 19:56:33.906451 21635 log.cc:824] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Log is configured to *not* fsync() on all Append() calls
I20260807 19:56:33.909775 21635 tablet_bootstrap.cc:492] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: No bootstrap required, opened a new log
I20260807 19:56:33.909773 21634 tablet_bootstrap.cc:492] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: No bootstrap required, opened a new log
I20260807 19:56:33.910054 21634 ts_tablet_manager.cc:1397] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260807 19:56:33.910053 21635 ts_tablet_manager.cc:1397] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260807 19:56:33.911962 21632 raft_consensus.cc:348] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:33.912360 21632 raft_consensus.cc:374] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:33.912461 21632 raft_consensus.cc:729] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be6d5c3e2497416db0cf57ea32be7767, State: Initialized, Role: FOLLOWER
I20260807 19:56:33.913089 21632 consensus_queue.cc:260] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:33.914429 21369 heartbeater.cc:503] Master 127.5.197.190:44057 was elected leader, sending a full tablet report...
I20260807 19:56:33.916522 21632 ts_tablet_manager.cc:1428] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Time spent starting tablet: real 0.012s user 0.006s sys 0.005s
I20260807 19:56:33.920663 21634 raft_consensus.cc:348] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:33.920665 21635 raft_consensus.cc:348] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:33.921139 21634 raft_consensus.cc:374] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:33.921139 21635 raft_consensus.cc:374] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:56:33.921247 21635 raft_consensus.cc:729] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec2187960d53446dadbd90e4a0c20cf6, State: Initialized, Role: FOLLOWER
I20260807 19:56:33.921248 21634 raft_consensus.cc:729] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f335fc3e546648b5a58cf1f36cd75521, State: Initialized, Role: FOLLOWER
I20260807 19:56:33.921901 21634 consensus_queue.cc:260] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:33.921892 21635 consensus_queue.cc:260] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:33.923573 21600 heartbeater.cc:503] Master 127.5.197.190:44057 was elected leader, sending a full tablet report...
I20260807 19:56:33.924213 21634 ts_tablet_manager.cc:1428] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Time spent starting tablet: real 0.014s user 0.011s sys 0.005s
I20260807 19:56:33.924973 21635 ts_tablet_manager.cc:1428] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Time spent starting tablet: real 0.015s user 0.010s sys 0.005s
W20260807 19:56:33.956678 21150 tablet.cc:2369] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:56:33.988818 21370 tablet.cc:2369] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:56:34.029948 21642 raft_consensus.cc:482] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:56:34.030264 21642 raft_consensus.cc:504] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
W20260807 19:56:34.031863 21601 tablet.cc:2369] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:56:34.032085 21642 leader_election.cc:288] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be6d5c3e2497416db0cf57ea32be7767 (127.5.197.130:45791), f335fc3e546648b5a58cf1f36cd75521 (127.5.197.131:39829)
I20260807 19:56:34.038959 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.032832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:34497 (local address 127.5.197.130:45791)
0807 19:56:34.033055 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:34.033062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:34.033186 (+ 124us) server_negotiation.cc:407] Connection header received
0807 19:56:34.033428 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:34.033432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:34.033495 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:34.033583 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:56:34.034206 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.034941 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.037016 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.037776 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.038058 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.038171 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:34.038423 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 19:56:34.038607 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 19:56:34.038970 21643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.032422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39829 (local address 127.5.197.129:52071)
0807 19:56:34.033436 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:34.033449 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:34.033556 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:34.033847 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:34.033851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:34.033889 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:56:34.034229 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:34.034238 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.035284 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.035288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:34.036847 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:34.036868 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.037985 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.037991 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:34.038169 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.038222 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 19:56:34.038313 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 19:56:34.038446 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":906,"mutex_wait_us":3,"thread_start_us":337,"threads_started":1}
I20260807 19:56:34.038996 21645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.032366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:45791 (local address 127.5.197.129:34497)
0807 19:56:34.033066 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0807 19:56:34.033089 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:56:34.033270 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:56:34.033625 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:56:34.033630 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:56:34.033658 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:56:34.034042 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:34.034055 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.035067 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.035073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:34.036864 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:56:34.036876 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.038031 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.038037 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:56:34.038241 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.038273 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:56:34.038355 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 19:56:34.038477 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":133,"thread_start_us":794,"threads_started":1}
I20260807 19:56:34.039343 21631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.032533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:52071 (local address 127.5.197.131:39829)
0807 19:56:34.032752 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:34.032759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:34.033527 (+ 768us) server_negotiation.cc:407] Connection header received
0807 19:56:34.033673 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:34.033677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:34.033734 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:34.033806 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:56:34.034377 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.035148 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.036997 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.037755 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.037901 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.038946 (+ 1045us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:34.039002 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 19:56:34.039119 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:56:34.040176 21522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9acecd5b2ee74a4ebd9b810287c7afac" candidate_uuid: "ec2187960d53446dadbd90e4a0c20cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f335fc3e546648b5a58cf1f36cd75521" is_pre_election: true
I20260807 19:56:34.040176 21301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9acecd5b2ee74a4ebd9b810287c7afac" candidate_uuid: "ec2187960d53446dadbd90e4a0c20cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be6d5c3e2497416db0cf57ea32be7767" is_pre_election: true
I20260807 19:56:34.040701 21522 raft_consensus.cc:2454] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec2187960d53446dadbd90e4a0c20cf6 in term 0.
I20260807 19:56:34.040735 21301 raft_consensus.cc:2454] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec2187960d53446dadbd90e4a0c20cf6 in term 0.
I20260807 19:56:34.041348 20969 leader_election.cc:302] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec2187960d53446dadbd90e4a0c20cf6, f335fc3e546648b5a58cf1f36cd75521; no voters:
I20260807 19:56:34.041764 21642 raft_consensus.cc:2781] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:56:34.041898 21642 raft_consensus.cc:482] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:56:34.042011 21642 raft_consensus.cc:3037] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:34.045102 21642 raft_consensus.cc:504] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:34.046059 21642 leader_election.cc:288] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [CANDIDATE]: Term 1 election: Requested vote from peers be6d5c3e2497416db0cf57ea32be7767 (127.5.197.130:45791), f335fc3e546648b5a58cf1f36cd75521 (127.5.197.131:39829)
I20260807 19:56:34.046377 21301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9acecd5b2ee74a4ebd9b810287c7afac" candidate_uuid: "ec2187960d53446dadbd90e4a0c20cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be6d5c3e2497416db0cf57ea32be7767"
I20260807 19:56:34.046593 21301 raft_consensus.cc:3037] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:34.048414 21522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9acecd5b2ee74a4ebd9b810287c7afac" candidate_uuid: "ec2187960d53446dadbd90e4a0c20cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f335fc3e546648b5a58cf1f36cd75521"
I20260807 19:56:34.048619 21522 raft_consensus.cc:3037] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:56:34.049721 21301 raft_consensus.cc:2454] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec2187960d53446dadbd90e4a0c20cf6 in term 1.
I20260807 19:56:34.050221 20971 leader_election.cc:302] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be6d5c3e2497416db0cf57ea32be7767, ec2187960d53446dadbd90e4a0c20cf6; no voters:
I20260807 19:56:34.051537 21522 raft_consensus.cc:2454] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec2187960d53446dadbd90e4a0c20cf6 in term 1.
I20260807 19:56:34.052809 21647 raft_consensus.cc:2781] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:56:34.053030 21647 raft_consensus.cc:686] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 1 LEADER]: Becoming Leader. State: Replica: ec2187960d53446dadbd90e4a0c20cf6, State: Running, Role: LEADER
I20260807 19:56:34.053625 21647 consensus_queue.cc:237] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } }
I20260807 19:56:34.058754 20825 catalog_manager.cc:5495] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec2187960d53446dadbd90e4a0c20cf6 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "ec2187960d53446dadbd90e4a0c20cf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec2187960d53446dadbd90e4a0c20cf6" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260807 19:56:34.105602 21628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.099932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35780 (local address 127.5.197.129:46435)
0807 19:56:34.100199 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:34.100206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:34.100335 (+ 129us) server_negotiation.cc:407] Connection header received
0807 19:56:34.100573 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:34.100577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:34.100679 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:34.100845 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:56:34.101307 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.102039 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.103378 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.103826 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.103941 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.104459 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:56:34.104998 (+ 539us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:56:34.105139 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:34.105248 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 19:56:34.105339 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 19:56:34.114462 21522 raft_consensus.cc:1261] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 1 FOLLOWER]: Refusing update from remote peer ec2187960d53446dadbd90e4a0c20cf6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:56:34.114462 21301 raft_consensus.cc:1261] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 1 FOLLOWER]: Refusing update from remote peer ec2187960d53446dadbd90e4a0c20cf6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:56:34.115687 21647 consensus_queue.cc:1035] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f335fc3e546648b5a58cf1f36cd75521" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:56:34.116084 21642 consensus_queue.cc:1035] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be6d5c3e2497416db0cf57ea32be7767" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:56:34.141325 20825 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54350:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:56:34.141593 20825 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54350:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:56:34.145385 20825 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15a9bc77be3643ec9ea90acbb71b5af0: Sending DeleteTablet for 3 replicas of tablet 9acecd5b2ee74a4ebd9b810287c7afac
I20260807 19:56:34.146504 21264 tablet_service.cc:1514] Processing DeleteTablet for tablet 9acecd5b2ee74a4ebd9b810287c7afac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:34 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:35350
I20260807 19:56:34.146538 21043 tablet_service.cc:1514] Processing DeleteTablet for tablet 9acecd5b2ee74a4ebd9b810287c7afac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:34 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:35774
I20260807 19:56:34.146852 21487 tablet_service.cc:1514] Processing DeleteTablet for tablet 9acecd5b2ee74a4ebd9b810287c7afac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:56:34 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:44898
I20260807 19:56:34.149214 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 20934
I20260807 19:56:34.158983 21671 tablet_replica.cc:330] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: stopping tablet replica
I20260807 19:56:34.159687 21671 raft_consensus.cc:2229] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:56:34.160331 21671 raft_consensus.cc:2258] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:34.161406 21672 tablet_replica.cc:330] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: stopping tablet replica
I20260807 19:56:34.162743 21670 tablet_replica.cc:330] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: stopping tablet replica
I20260807 19:56:34.163087 21671 ts_tablet_manager.cc:1905] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:34.163290 21670 raft_consensus.cc:2229] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:56:34.163565 21672 raft_consensus.cc:2229] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:56:34.164078 21670 raft_consensus.cc:2258] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:34.164899 21672 raft_consensus.cc:2258] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:56:34.166469 21670 ts_tablet_manager.cc:1905] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:34.170226 21672 ts_tablet_manager.cc:1905] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:56:34.171522 21671 ts_tablet_manager.cc:1918] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:56:34.171772 21671 log.cc:1196] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/9acecd5b2ee74a4ebd9b810287c7afac
I20260807 19:56:34.172389 21671 ts_tablet_manager.cc:1939] T 9acecd5b2ee74a4ebd9b810287c7afac P be6d5c3e2497416db0cf57ea32be7767: Deleting consensus metadata
I20260807 19:56:34.173823 21670 ts_tablet_manager.cc:1918] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:56:34.174250 21670 log.cc:1196] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/9acecd5b2ee74a4ebd9b810287c7afac
I20260807 19:56:34.174368 20803 catalog_manager.cc:4841] TS be6d5c3e2497416db0cf57ea32be7767 (127.5.197.130:45791): tablet 9acecd5b2ee74a4ebd9b810287c7afac (table test-table [id=6d32eae0369a44f3b5c4cc54e5eff6af]) successfully deleted
I20260807 19:56:34.174957 21670 ts_tablet_manager.cc:1939] T 9acecd5b2ee74a4ebd9b810287c7afac P ec2187960d53446dadbd90e4a0c20cf6: Deleting consensus metadata
I20260807 19:56:34.176855 20800 catalog_manager.cc:4841] TS ec2187960d53446dadbd90e4a0c20cf6 (127.5.197.129:46435): tablet 9acecd5b2ee74a4ebd9b810287c7afac (table test-table [id=6d32eae0369a44f3b5c4cc54e5eff6af]) successfully deleted
I20260807 19:56:34.177165 21672 ts_tablet_manager.cc:1918] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:56:34.177379 21672 log.cc:1196] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/9acecd5b2ee74a4ebd9b810287c7afac
I20260807 19:56:34.177927 21672 ts_tablet_manager.cc:1939] T 9acecd5b2ee74a4ebd9b810287c7afac P f335fc3e546648b5a58cf1f36cd75521: Deleting consensus metadata
Aug 07 19:56:34 dist-test-slave-6bbx krb5kdc[20752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:56:34.179877 20801 catalog_manager.cc:4841] TS f335fc3e546648b5a58cf1f36cd75521 (127.5.197.131:39829): tablet 9acecd5b2ee74a4ebd9b810287c7afac (table test-table [id=6d32eae0369a44f3b5c4cc54e5eff6af]) successfully deleted
I20260807 19:56:34.185659 21628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.151850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35796 (local address 127.5.197.129:46435)
0807 19:56:34.152283 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:34.152289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:34.161999 (+ 9710us) server_negotiation.cc:407] Connection header received
0807 19:56:34.162242 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:34.162249 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:34.162379 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:34.162503 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:34.164413 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.165632 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.167914 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.168653 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.168766 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.179467 (+ 10701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:34.179484 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:34.179504 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:34.179569 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:34.182750 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:34.183464 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:34.183475 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:34.183477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:34.183642 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:34.184078 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:34.184082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:34.184085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:34.184462 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:34.184750 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:34.185083 (+ 333us) server_negotiation.cc:299] Negotiation successful
0807 19:56:34.185332 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311}
I20260807 19:56:34.186349 21141 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:34.300398 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 20934
I20260807 19:56:34.328183 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 21156
Aug 07 19:56:34 dist-test-slave-6bbx krb5kdc[20752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:56:34.343341 21627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.328949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35354 (local address 127.5.197.130:45791)
0807 19:56:34.329142 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:34.329148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:34.329211 (+ 63us) server_negotiation.cc:407] Connection header received
0807 19:56:34.329430 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:34.329435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:34.329505 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:34.329594 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:34.330881 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.331626 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.332872 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.333252 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.333377 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.337555 (+ 4178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:34.337571 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:34.337588 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:34.337627 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:34.340542 (+ 2915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:34.341215 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:34.341223 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:34.341225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:34.341358 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:34.341725 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:34.341729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:34.341731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:34.342154 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:34.342464 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:34.342761 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 19:56:34.342975 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 19:56:34.343997 21362 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:34.433322 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 21156
I20260807 19:56:34.457700 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 21378
Aug 07 19:56:34 dist-test-slave-6bbx krb5kdc[20752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:56:34.472901 21631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:56:34.458525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44908 (local address 127.5.197.131:39829)
0807 19:56:34.458722 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 19:56:34.458728 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:56:34.458750 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:56:34.458873 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:56:34.458878 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:56:34.458959 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:56:34.459052 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:56:34.460472 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.461188 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.462488 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:56:34.462890 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:56:34.463001 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:56:34.467331 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:56:34.467348 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:56:34.467368 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:56:34.467405 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:56:34.470055 (+ 2650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:34.470712 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:34.470719 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:34.470722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:34.470882 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:56:34.471237 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:56:34.471241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:56:34.471243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:56:34.471597 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:56:34.472042 (+ 445us) server_negotiation.cc:1035] Waiting for connection context
0807 19:56:34.472333 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 19:56:34.472561 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 19:56:34.473632 21589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:34.563565 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 21378
I20260807 19:56:34.585160 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 20775
I20260807 19:56:34.586344 20876 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:56:34.697628 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 20775
2026-08-07T19:56:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4590 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:56:34 dist-test-slave-6bbx krb5kdc[21683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:56:34 dist-test-slave-6bbx krb5kdc[21683](info): set up 2 sockets
Aug 07 19:56:34 dist-test-slave-6bbx krb5kdc[21683](info): commencing operation
krb5kdc: starting...
W20260807 19:56:35.919929 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:56:36 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:56:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:56:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/rangeradmin_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/rangeradmin_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/rangerlookup_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/rangerlookup_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
I20260807 19:56:36.327579 5910 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskQ2gOvL/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/postgres -l logfile start
2026-08-07 19:56:38.818 UTC [21732] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 19:56:38.818 UTC [21732] LOG: listening on IPv4 address "127.5.197.148", port 37769
2026-08-07 19:56:38.821 UTC [21732] LOG: listening on Unix socket "/tmp/.s.PGSQL.37769"
2026-08-07 19:56:38.841 UTC [21735] LOG: database system was shut down at 2026-08-07 19:56:37 UTC
2026-08-07 19:56:38.845 UTC [21732] LOG: database system is ready to accept connections
I20260807 19:56:39.919042 5910 mini_postgres.cc:96] Postgres bound to 37769
2026-08-07 19:56:39.947 UTC [21744] FATAL: database "slave" does not exist
127.5.197.148:37769 - accepting connections
I20260807 19:56:39.948508 5910 mini_ranger.cc:161] Starting Ranger...
I20260807 19:56:39.986304 5910 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 19:56:40.456182 5910 mini_ranger.cc:87] Created ranger Postgres database
I20260807 19:56:40.456408 5910 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-admin
2026-08-07 19:56:40,938 [I] DB FLAVOR :POSTGRES
2026-08-07 19:56:40,938 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:56:40,938 [I] Checking connection..
2026-08-07 19:56:40,938 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 19:56:41,227 [I] Checking connection passed.
2026-08-07 19:56:41,228 [I] --------- Verifying version history table ---------
2026-08-07 19:56:41,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:56:41,474 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:56:41,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:56:41,735 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:56:41,735 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 19:56:41,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 19:56:41.987 UTC [21860] WARNING: there is no transaction in progress
2026-08-07 19:56:41,995 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 19:56:41,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:56:42,248 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 19:56:42,248 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:56:42,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 19:56:42,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 19:56:42,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6bbx.c.gcp-upstream.internal','N') ;"
2026-08-07 19:56:43,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:56:43,279 [I] Table x_portal_user does not exist in database ranger
2026-08-07 19:56:43,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:56:43,541 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 19:56:43,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:56:43,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:56:44,063 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 19:56:44,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 19:56:44.986 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.001 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.017 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.031 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.045 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.063 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.124 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.131 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.145 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.155 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.165 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.178 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.188 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.194 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.200 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45.207 UTC [22044] WARNING: there is no transaction in progress
2026-08-07 19:56:45,793 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 19:56:45,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 19:56:46,043 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 19:56:46,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:56:46,284 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 19:56:46,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:56:46,546 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 19:56:46,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:56:46,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:56:47,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6bbx.c.gcp-upstream.internal';"
2026-08-07 19:56:47,278 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 19:56:47,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 19:56:47,534 [I] DB_PATCHES have already been applied
I20260807 19:56:47.540095 5910 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-admin:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskQ2gOvL/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 19:56:47.540203 5910 mini_ranger.cc:193] Using host: 127.5.197.148
I20260807 19:56:47.562245 5910 mini_ranger.cc:227] Ranger admin URL: http://127.5.197.148:51097
Aug 07, 2026 7:56:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:56:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:56:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 7:56:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 7:56:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 7:56:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 7:56:48 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 19:56:48.803548 5910 mini_ranger.cc:160] Time spent starting Ranger: real 8.855s user 0.002s sys 0.068s
Aug 07, 2026 7:57:10 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 7:57:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 7:57:10 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 7:57:10 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 7:57:11 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 19:57:11.784116 5910 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/rangerkms_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/rangerkms_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.197.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.5.197.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 19:57:11 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132631, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 19:57:11.985343 5910 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 19:57:12.015594 5910 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 19:57:12.829459 5910 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 19:57:12.829630 5910 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms
I20260807 19:57:12.829780 5910 mini_ranger_kms.cc:227] Using postgres at 127.5.197.148:37769
2026-08-07 19:57:13,486 [I] DB FLAVOR :POSTGRES
2026-08-07 19:57:13,486 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:57:13,486 [I] Checking connection
2026-08-07 19:57:13,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 19:57:13,747 [I] connection success
2026-08-07 19:57:13,747 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 19:57:13,747 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 19:57:13,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 19:57:13,986 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 19:57:13,986 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:57:13,987 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 19:57:13,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:37769/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 19:57:14,272 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 19:57:14.765978 5910 mini_ranger_kms.cc:310] Created kms service
I20260807 19:57:14.962960 5910 mini_ranger_kms.cc:326] Created kudu user
I20260807 19:57:15.006279 5910 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 19:57:15 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132631, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:57:15.437000 5910 mini_ranger_kms.cc:384] Added ranger policy
I20260807 19:57:15.437316 5910 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms:/tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 19:57:15.437363 5910 mini_ranger_kms.cc:240] Using host: 127.5.197.148
I20260807 19:57:15.471542 5910 mini_ranger_kms.cc:276] Ranger KMS PID: 22367
I20260807 19:57:15.471792 5910 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.5.197.148:37377
Aug 07, 2026 7:57:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:57:16 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:57:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 7:57:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 7:57:16 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 7:57:16 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 19:57:17 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132637, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.197.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:57:17.983705 5910 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.998s user 0.137s sys 0.451s
I20260807 19:57:17.984104 5910 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 19:57:17.984359 5910 mini_ranger_kms.cc:401] 127.5.197.148:37377/kms/v1/keys
Aug 07 19:57:18 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132637, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.197.148@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
Aug 07 19:57:18 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132637, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.197.148@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
Aug 07 19:57:20 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:57:20.845461 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33957
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:33957
--ranger_config_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:37377/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:57:21.190289 22461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:57:21.190577 22461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:57:21.190721 22461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:57:21.198877 22461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:57:21.198998 22461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:57:21.199075 22461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:57:21.199147 22461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:57:21.199219 22461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:57:21.209551 22461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/wal
--ranger_kms_url=127.5.197.148:37377/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:33957
--ranger_config_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:57:21.210798 22461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:57:21.212167 22461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:57:21.224606 22467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:57:21.224625 22468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:57:21.228353 22470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:57:21.229365 22461 server_base.cc:1034] running on GCE node
I20260807 19:57:21.230374 22461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:57:21.232225 22461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:57:21.233474 22461 hybrid_clock.cc:648] HybridClock initialized: now 1786132641233410 us; error 48 us; skew 500 ppm
I20260807 19:57:21.233904 22461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:57:21 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132641, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:57:21.237850 22461 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:57:21.239657 22461 webserver.cc:460] Webserver started at http://127.5.197.190:39059/ using document root <none> and password file <none>
I20260807 19:57:21.240542 22461 fs_manager.cc:359] Metadata directory not provided
I20260807 19:57:21.240670 22461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:57:21.241051 22461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:57:21 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132641, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:57:21.307436 22461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "a070f6bfc9964baab6e6305969c698f5"
format_stamp: "Formatted at 2026-08-07 19:57:21 on dist-test-slave-6bbx"
server_key: "5971c6dd24647f965715f97aa8af80ac"
server_key_iv: "b410d14b203ae6d3ef4568617395df4a"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:21.308382 22461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "a070f6bfc9964baab6e6305969c698f5"
format_stamp: "Formatted at 2026-08-07 19:57:21 on dist-test-slave-6bbx"
server_key: "5971c6dd24647f965715f97aa8af80ac"
server_key_iv: "b410d14b203ae6d3ef4568617395df4a"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:21.313848 22461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:57:21.333457 22482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:21.334878 22461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:57:21.335033 22461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "a070f6bfc9964baab6e6305969c698f5"
format_stamp: "Formatted at 2026-08-07 19:57:21 on dist-test-slave-6bbx"
server_key: "5971c6dd24647f965715f97aa8af80ac"
server_key_iv: "b410d14b203ae6d3ef4568617395df4a"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:21.335239 22461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:57:21.350024 22461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:57:21.353829 22461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:57:21.354107 22461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:57:21.371735 22461 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:33957
I20260807 19:57:21.371775 22573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:33957 every 8 connection(s)
I20260807 19:57:21.373018 22461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:57:21.376641 22574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:57:21.379935 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 22461
I20260807 19:57:21.380108 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:57:21.380688 5910 external_mini_cluster.cc:1428] Setting key 735becf70e4e55bc7d3fd3508285aa86
I20260807 19:57:21.388592 22574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5: Bootstrap starting.
I20260807 19:57:21.391582 22574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5: Neither blocks nor log segments found. Creating new log.
I20260807 19:57:21.392557 22574 log.cc:824] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:57:21 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:57:21.395533 22574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5: No bootstrap required, opened a new log
I20260807 19:57:21.402769 22577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:21.382638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50116 (local address 127.5.197.190:33957)
0807 19:57:21.383461 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:21.383473 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:21.383516 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:57:21.385266 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:21.385291 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:21.385682 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:21.386071 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:21.387397 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:21.388766 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:21.390003 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:21.390682 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:21.390844 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:21.394561 (+ 3717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:21.394572 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:21.394589 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:21.394638 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:21.398471 (+ 3833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:21.399116 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:21.399124 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:21.399132 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:21.399347 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:21.399686 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:21.399692 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:21.399695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:21.400382 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:21.400693 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:21.400994 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 19:57:21.401407 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":388,"threads_started":1}
I20260807 19:57:21.405735 22574 raft_consensus.cc:348] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a070f6bfc9964baab6e6305969c698f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33957 } }
I20260807 19:57:21.406056 22574 raft_consensus.cc:374] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:57:21.406131 22574 raft_consensus.cc:729] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a070f6bfc9964baab6e6305969c698f5, State: Initialized, Role: FOLLOWER
I20260807 19:57:21.406587 22574 consensus_queue.cc:260] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a070f6bfc9964baab6e6305969c698f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33957 } }
I20260807 19:57:21.406795 22574 raft_consensus.cc:388] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:57:21.406894 22574 raft_consensus.cc:482] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:57:21.407011 22574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:57:21.409055 22574 raft_consensus.cc:504] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a070f6bfc9964baab6e6305969c698f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33957 } }
I20260807 19:57:21.409552 22574 leader_election.cc:302] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a070f6bfc9964baab6e6305969c698f5; no voters:
I20260807 19:57:21.410145 22574 leader_election.cc:288] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:57:21.410244 22581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:57:21.410914 22581 raft_consensus.cc:686] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [term 1 LEADER]: Becoming Leader. State: Replica: a070f6bfc9964baab6e6305969c698f5, State: Running, Role: LEADER
I20260807 19:57:21.411448 22581 consensus_queue.cc:237] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a070f6bfc9964baab6e6305969c698f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33957 } }
I20260807 19:57:21.412089 22574 sys_catalog.cc:564] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:57:21.414387 22583 sys_catalog.cc:455] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a070f6bfc9964baab6e6305969c698f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a070f6bfc9964baab6e6305969c698f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33957 } } }
I20260807 19:57:21.414849 22583 sys_catalog.cc:458] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:57:21.415349 22584 sys_catalog.cc:455] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a070f6bfc9964baab6e6305969c698f5. Latest consensus state: current_term: 1 leader_uuid: "a070f6bfc9964baab6e6305969c698f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a070f6bfc9964baab6e6305969c698f5" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33957 } } }
I20260807 19:57:21.415649 22584 sys_catalog.cc:458] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:57:21.416960 22589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:57:21.421314 22589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:57:21.422241 22574 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 19:57:21.439884 22589 catalog_manager.cc:1347] Generated new cluster ID: c26edfe64e0f41598824cc0cf1eeec88
I20260807 19:57:21.440021 22589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:57:21.466228 22589 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:57:21.467519 22589 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:57:21.480957 22589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5: Generated new TSK 0
I20260807 19:57:21.481758 22589 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:57:22.195050 22636 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:57:22.301017 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:37377/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33957
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:57:22 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132642, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 19:57:22.678757 22641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:57:22.679049 22641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:57:22.679191 22641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:57:22.689729 22641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:57:22.689872 22641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:57:22.690116 22641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:57:22.705819 22641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.5.197.148:37377/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:57:22.707486 22641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:57:22.709211 22641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:57:22.727754 22655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:57:22.728250 22657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:57:22.734911 22659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:57:22.735879 22641 server_base.cc:1034] running on GCE node
I20260807 19:57:22.736857 22641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:57:22.739446 22641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:57:22.740778 22641 hybrid_clock.cc:648] HybridClock initialized: now 1786132642740640 us; error 120 us; skew 500 ppm
I20260807 19:57:22.741169 22641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:57:22 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132642, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:57:22.745488 22641 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:57:22.747493 22641 webserver.cc:460] Webserver started at http://127.5.197.129:33253/ using document root <none> and password file <none>
I20260807 19:57:22.748481 22641 fs_manager.cc:359] Metadata directory not provided
I20260807 19:57:22.748695 22641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:57:22.749145 22641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:57:22 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132642, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:57:22.769714 22641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "0fc5a0ed7ec843618050ad6d168c7d0c"
format_stamp: "Formatted at 2026-08-07 19:57:22 on dist-test-slave-6bbx"
server_key: "fa91102fc03d6cfebd0bfb1e479d128b"
server_key_iv: "42456366f5e42da99071a10b51ebfb0c"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:22.770957 22641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "0fc5a0ed7ec843618050ad6d168c7d0c"
format_stamp: "Formatted at 2026-08-07 19:57:22 on dist-test-slave-6bbx"
server_key: "fa91102fc03d6cfebd0bfb1e479d128b"
server_key_iv: "42456366f5e42da99071a10b51ebfb0c"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:22.783921 22641 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.008s sys 0.004s
I20260807 19:57:22.802232 22672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:22.805249 22641 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260807 19:57:22.805537 22641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "0fc5a0ed7ec843618050ad6d168c7d0c"
format_stamp: "Formatted at 2026-08-07 19:57:22 on dist-test-slave-6bbx"
server_key: "fa91102fc03d6cfebd0bfb1e479d128b"
server_key_iv: "42456366f5e42da99071a10b51ebfb0c"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:22.805912 22641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:57:22.860986 22641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:57:22.866001 22641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:57:22.866508 22641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:57:22.867880 22641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:57:22.869370 22641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:57:22.869452 22641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:22.869566 22641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:57:22.869622 22641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:22.988097 22641 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:39191
I20260807 19:57:22.988149 22873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:39191 every 8 connection(s)
I20260807 19:57:22.989943 22641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:57:22.996464 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 22641
I20260807 19:57:22.996670 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:57:22.997530 5910 external_mini_cluster.cc:1428] Setting key d0bb3a05ea1746d49721d1346db738a1
Aug 07 19:57:23 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132642, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
Aug 07 19:57:23 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132642, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:57:23.042361 22880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:23.002993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:42703 (local address 127.5.197.190:33957)
0807 19:57:23.021176 (+ 18183us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:23.021182 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:23.021203 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:57:23.021266 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:23.021271 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:23.021357 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:23.021469 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:23.024125 (+ 2656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.025279 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.027724 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.028369 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.028467 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:23.033040 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:23.033047 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:23.033051 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:23.033102 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:23.036305 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:23.039498 (+ 3193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:23.039504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:23.039508 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:23.039733 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:23.040308 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:23.040313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:23.040317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:23.040680 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:23.040794 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:23.041752 (+ 958us) server_negotiation.cc:299] Negotiation successful
0807 19:57:23.041982 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18058,"thread_start_us":17933,"threads_started":1}
I20260807 19:57:23.044564 22879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:23.002383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33957 (local address 127.5.197.129:42703)
0807 19:57:23.017817 (+ 15434us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:23.017874 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:23.020395 (+ 2521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:23.021976 (+ 1581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:23.021990 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:23.023027 (+ 1037us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:57:23.023910 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:23.023938 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.025485 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.025489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:23.027513 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:23.027539 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.028822 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.028830 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:23.029117 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:23.030146 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:57:23.030194 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:57:23.032832 (+ 2638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:57:23.038573 (+ 5741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:57:23.038583 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:57:23.038601 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:57:23.039352 (+ 751us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:57:23.039888 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:57:23.039892 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:57:23.039896 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:57:23.040157 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:57:23.040895 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:57:23.040903 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:57:23.041324 (+ 421us) client_negotiation.cc:769] Sending connection context
0807 19:57:23.042663 (+ 1339us) client_negotiation.cc:240] Negotiation successful
0807 19:57:23.043191 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15056,"thread_start_us":14799,"threads_started":1}
I20260807 19:57:23.046631 22875 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33957
I20260807 19:57:23.046977 22875 heartbeater.cc:464] Registering TS with master...
I20260807 19:57:23.047835 22875 heartbeater.cc:511] Master 127.5.197.190:33957 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
I20260807 19:57:23.050508 22512 ts_manager.cc:194] Registered new tserver with Master: 0fc5a0ed7ec843618050ad6d168c7d0c (127.5.197.129:39191)
I20260807 19:57:23.052740 22512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:42703
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:57:23.101439 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:37377/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33957
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:57:23 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132642, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
W20260807 19:57:23.631093 22888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:57:23.631685 22888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:57:23.631942 22888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:57:23.643494 22888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:57:23.643735 22888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:57:23.643957 22888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:57:23.659117 22888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.5.197.148:37377/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:57:23.661166 22888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:57:23.662977 22888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:57:23.707379 22899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:57:23.707492 22907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:57:23.707994 22888 server_base.cc:1034] running on GCE node
W20260807 19:57:23.708531 22900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:57:23.709901 22888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:57:23.716413 22888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:57:23.718264 22888 hybrid_clock.cc:648] HybridClock initialized: now 1786132643718154 us; error 109 us; skew 500 ppm
I20260807 19:57:23.718706 22888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:57:23 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132643, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:57:23.726440 22888 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:57:23.764120 22888 webserver.cc:460] Webserver started at http://127.5.197.130:45117/ using document root <none> and password file <none>
I20260807 19:57:23.765334 22888 fs_manager.cc:359] Metadata directory not provided
I20260807 19:57:23.765573 22888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:57:23.766043 22888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:57:23 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132643, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:57:23.800450 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "35a64306428c4c2db5524f092c7b80f1"
format_stamp: "Formatted at 2026-08-07 19:57:23 on dist-test-slave-6bbx"
server_key: "e91516c80315ce9c3c7c83fabe9e9928"
server_key_iv: "1beeb7693f43a38824a06185c70da572"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:23.801545 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "35a64306428c4c2db5524f092c7b80f1"
format_stamp: "Formatted at 2026-08-07 19:57:23 on dist-test-slave-6bbx"
server_key: "e91516c80315ce9c3c7c83fabe9e9928"
server_key_iv: "1beeb7693f43a38824a06185c70da572"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:23.833539 22888 fs_manager.cc:691] Time spent creating directory manager: real 0.032s user 0.007s sys 0.011s
I20260807 19:57:23.850421 22933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:23.852514 22888 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:57:23.852807 22888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "35a64306428c4c2db5524f092c7b80f1"
format_stamp: "Formatted at 2026-08-07 19:57:23 on dist-test-slave-6bbx"
server_key: "e91516c80315ce9c3c7c83fabe9e9928"
server_key_iv: "1beeb7693f43a38824a06185c70da572"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:23.853188 22888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:57:23.873498 22888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:57:23.878665 22888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:57:23.879069 22888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:57:23.880306 22888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:57:23.882189 22888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:57:23.882290 22888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:23.882475 22888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:57:23.882560 22888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:23.952298 23127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:33889 every 8 connection(s)
I20260807 19:57:23.952330 22888 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:33889
I20260807 19:57:23.954317 22888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:57:23.962880 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 22888
I20260807 19:57:23.963048 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:57:23.963598 5910 external_mini_cluster.cc:1428] Setting key c33f3ce2293fe4b61656a9d094b4b302
Aug 07 19:57:23 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132643, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:57:23.986702 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:23.957873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33957 (local address 127.5.197.130:37475)
0807 19:57:23.964318 (+ 6445us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:23.964382 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:23.966774 (+ 2392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:23.969423 (+ 2649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:23.969435 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:23.969927 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:57:23.970576 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:23.970595 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.971653 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.971657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:23.973234 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:23.973247 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.974051 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.974061 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:23.974292 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:23.975058 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:57:23.975083 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:57:23.977827 (+ 2744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:57:23.981579 (+ 3752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:57:23.981586 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:57:23.981598 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:57:23.982051 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:57:23.982494 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:57:23.982497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:57:23.982499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:57:23.982714 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:57:23.983319 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:57:23.983327 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:57:23.983843 (+ 516us) client_negotiation.cc:769] Sending connection context
0807 19:57:23.984309 (+ 466us) client_negotiation.cc:240] Negotiation successful
0807 19:57:23.984951 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6080,"thread_start_us":5846,"threads_started":1}
I20260807 19:57:23.988858 23133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:23.958521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:37475 (local address 127.5.197.190:33957)
0807 19:57:23.968867 (+ 10346us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:23.968872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:23.968887 (+ 15us) server_negotiation.cc:407] Connection header received
0807 19:57:23.968935 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:23.968939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:23.969005 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:23.969109 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:23.970752 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.971504 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.973386 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:23.973777 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:23.973893 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:23.978073 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:23.978078 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:23.978082 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:23.978113 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:23.981416 (+ 3303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:23.982192 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:23.982196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:23.982198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:23.982381 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:23.982833 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:23.982838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:23.982841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:23.983185 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:23.983416 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:23.988007 (+ 4591us) server_negotiation.cc:299] Negotiation successful
0807 19:57:23.988301 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10230,"thread_start_us":10094,"threads_started":1}
I20260807 19:57:23.990504 23129 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33957
I20260807 19:57:23.990808 23129 heartbeater.cc:464] Registering TS with master...
I20260807 19:57:23.991698 23129 heartbeater.cc:511] Master 127.5.197.190:33957 requested a full tablet report, sending...
I20260807 19:57:23.993544 22512 ts_manager.cc:194] Registered new tserver with Master: 35a64306428c4c2db5524f092c7b80f1 (127.5.197.130:33889)
I20260807 19:57:23.994469 22512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:37475
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:57:24.041186 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:37377/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33957
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:57:24.060276 22875 heartbeater.cc:503] Master 127.5.197.190:33957 was elected leader, sending a full tablet report...
W20260807 19:57:24.462962 23138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:57:24.463276 23138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:57:24.463394 23138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:57:24.471443 23138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:57:24.471542 23138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:57:24.471743 23138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:57:24.481437 23138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.5.197.148:37377/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:33957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:57:24.482808 23138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:57:24.484139 23138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:57:24.497745 23145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:57:24.502265 23148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:57:24.502445 23138 server_base.cc:1034] running on GCE node
W20260807 19:57:24.502473 23146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:57:24.503185 23138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:57:24.504179 23138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:57:24.505434 23138 hybrid_clock.cc:648] HybridClock initialized: now 1786132644505345 us; error 34 us; skew 500 ppm
I20260807 19:57:24.505745 23138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:57:24 dist-test-slave-6bbx krb5kdc[21683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132644, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:57:24.509069 23138 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:57:24.510752 23138 webserver.cc:460] Webserver started at http://127.5.197.131:44589/ using document root <none> and password file <none>
I20260807 19:57:24.511426 23138 fs_manager.cc:359] Metadata directory not provided
I20260807 19:57:24.511547 23138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:57:24.511927 23138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:57:24 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132644, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:57:24.528103 23138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "861dc2b385af470599cf93c5679418b8"
format_stamp: "Formatted at 2026-08-07 19:57:24 on dist-test-slave-6bbx"
server_key: "e50df6e5438d67b6a59f4d5d0554176a"
server_key_iv: "288c85ca781e86afaad9a3ff00d157f3"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:24.528956 23138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "861dc2b385af470599cf93c5679418b8"
format_stamp: "Formatted at 2026-08-07 19:57:24 on dist-test-slave-6bbx"
server_key: "e50df6e5438d67b6a59f4d5d0554176a"
server_key_iv: "288c85ca781e86afaad9a3ff00d157f3"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:24.534551 23138 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:57:24.549101 23158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:24.550678 23138 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:57:24.550844 23138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "861dc2b385af470599cf93c5679418b8"
format_stamp: "Formatted at 2026-08-07 19:57:24 on dist-test-slave-6bbx"
server_key: "e50df6e5438d67b6a59f4d5d0554176a"
server_key_iv: "288c85ca781e86afaad9a3ff00d157f3"
server_key_version: "kuduclusterkey@0"
I20260807 19:57:24.551052 23138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:57:24.570055 23138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:57:24.574672 23138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:57:24.575124 23138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:57:24.576502 23138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:57:24.578260 23138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:57:24.578383 23138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:24.578547 23138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:57:24.578658 23138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:57:24.616755 23138 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:33609
I20260807 19:57:24.616794 23378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:33609 every 8 connection(s)
I20260807 19:57:24.618053 23138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:57:24.624019 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 23138
I20260807 19:57:24.624235 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:57:24.624737 5910 external_mini_cluster.cc:1428] Setting key cf27dccf69a74d9c8fb567772f7e3d40
Aug 07 19:57:24 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132644, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:57:24.638300 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.620440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:59165 (local address 127.5.197.190:33957)
0807 19:57:24.621005 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.621011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.621834 (+ 823us) server_negotiation.cc:407] Connection header received
0807 19:57:24.624084 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.624090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.624182 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.624317 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:24.626122 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.627172 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.628984 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.629544 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.629643 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.632936 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:24.632942 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:24.632945 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:24.632979 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:24.635724 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:24.636376 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:24.636380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:24.636382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:24.636497 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:24.636840 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:24.636843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:24.636845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:24.637169 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:24.637283 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.637888 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.638041 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":263,"threads_started":1}
I20260807 19:57:24.639659 23385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.620930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:33957 (local address 127.5.197.131:59165)
0807 19:57:24.621665 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:24.621723 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:24.623808 (+ 2085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:24.624528 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:24.624536 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:24.624994 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:57:24.625834 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.625864 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.627344 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.627350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.628838 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.628859 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.629749 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.629754 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.630023 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.630605 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:57:24.630626 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:57:24.632671 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:57:24.635852 (+ 3181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:57:24.635858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:57:24.635869 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:57:24.636287 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:57:24.636573 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:57:24.636576 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:57:24.636578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:57:24.636760 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:57:24.637311 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:57:24.637316 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:57:24.637594 (+ 278us) client_negotiation.cc:769] Sending connection context
0807 19:57:24.637812 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 19:57:24.638202 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":282,"threads_started":1}
I20260807 19:57:24.640904 23381 heartbeater.cc:347] Connected to a master server at 127.5.197.190:33957
I20260807 19:57:24.641171 23381 heartbeater.cc:464] Registering TS with master...
I20260807 19:57:24.641829 23381 heartbeater.cc:511] Master 127.5.197.190:33957 requested a full tablet report, sending...
I20260807 19:57:24.643169 22512 ts_manager.cc:194] Registered new tserver with Master: 861dc2b385af470599cf93c5679418b8 (127.5.197.131:33609)
I20260807 19:57:24.644019 22512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:59165
I20260807 19:57:24.652156 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:57:24.669039 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.656681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50132 (local address 127.5.197.190:33957)
0807 19:57:24.656829 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.656834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.657442 (+ 608us) server_negotiation.cc:407] Connection header received
0807 19:57:24.657588 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.657591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.657659 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.657732 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:24.659095 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.660030 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.661344 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.661840 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.661935 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.664300 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:24.664305 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:24.664308 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:24.664348 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:24.666935 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:24.667507 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:24.667511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:24.667513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:24.667628 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:24.667975 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:24.667978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:24.667980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:24.668250 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:24.668429 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.668674 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.668826 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 19:57:24.672542 22512 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50132:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:57:24.679551 22512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:57:24.702808 23407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.691523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39191 (local address 127.0.0.1:60618)
0807 19:57:24.692232 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:24.692280 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:24.692433 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:24.693518 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:24.693525 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:24.693557 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:57:24.694089 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.694107 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.696876 (+ 2769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.696882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.699565 (+ 2683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.699586 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.701591 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.701598 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.701810 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.701867 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 19:57:24.701982 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 19:57:24.702201 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":28,"spinlock_wait_cycles":6528,"thread_start_us":342,"threads_started":1}
I20260807 19:57:24.703491 23410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.692710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.5.197.130:33889)
0807 19:57:24.693419 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.693427 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.693454 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:57:24.693871 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.693880 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.694115 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.694298 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:57:24.695285 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.697216 (+ 1931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.700271 (+ 3055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.701786 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.701928 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.702140 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.702933 (+ 793us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.703116 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":827,"threads_started":1}
I20260807 19:57:24.704160 23409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.692213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:33889 (local address 127.0.0.1:42074)
0807 19:57:24.693303 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:24.693320 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:24.693651 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:24.694557 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:24.694562 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:24.694589 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:57:24.694987 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.694998 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.697408 (+ 2410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.697414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.700084 (+ 2670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.700102 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.702323 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.702330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.702546 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.702585 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:57:24.702673 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 19:57:24.702813 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":972,"thread_start_us":838,"threads_started":1}
I20260807 19:57:24.704891 23408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.691945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60618 (local address 127.5.197.129:39191)
0807 19:57:24.692889 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.692899 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.692929 (+ 30us) server_negotiation.cc:407] Connection header received
0807 19:57:24.693035 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.693043 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.693280 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.694316 (+ 1036us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:57:24.694678 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.696695 (+ 2017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.699827 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.701351 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.704050 (+ 2699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.704300 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.704383 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.704547 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":694,"threads_started":1}
I20260807 19:57:24.709049 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 05f1df49eb264ba58fb9b8e41216a7ff (DEFAULT_TABLE table=test-table [id=961ff096d92a4caa8f945bb63d355899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:57:24.710551 22760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05f1df49eb264ba58fb9b8e41216a7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:57:24.711536 23020 tablet_service.cc:1467] Processing CreateTablet for tablet 05f1df49eb264ba58fb9b8e41216a7ff (DEFAULT_TABLE table=test-table [id=961ff096d92a4caa8f945bb63d355899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:57:24.712278 23407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.693437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:33609 (local address 127.0.0.1:45310)
0807 19:57:24.703589 (+ 10152us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:24.703607 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:24.703721 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:24.705557 (+ 1836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:24.705562 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:24.705585 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:57:24.705902 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.705918 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.707844 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.707849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.709588 (+ 1739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.709615 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.711510 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.711517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.711733 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.711767 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:57:24.711839 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 19:57:24.711982 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10054,"thread_start_us":14373,"threads_started":1}
I20260807 19:57:24.713304 23020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05f1df49eb264ba58fb9b8e41216a7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:57:24.713312 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.694041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.5.197.131:33609)
0807 19:57:24.705105 (+ 11064us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.705114 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.705144 (+ 30us) server_negotiation.cc:407] Connection header received
0807 19:57:24.705216 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.705222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.705392 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.705554 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:57:24.706117 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.707627 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.709774 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.711325 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.712514 (+ 1189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.712735 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.712807 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.712971 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10895,"thread_start_us":10636,"threads_started":1}
I20260807 19:57:24.717012 23248 tablet_service.cc:1467] Processing CreateTablet for tablet 05f1df49eb264ba58fb9b8e41216a7ff (DEFAULT_TABLE table=test-table [id=961ff096d92a4caa8f945bb63d355899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:57:24.718642 23248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05f1df49eb264ba58fb9b8e41216a7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:57:24.726616 23416 tablet_bootstrap.cc:492] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Bootstrap starting.
I20260807 19:57:24.728660 23419 tablet_bootstrap.cc:492] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Bootstrap starting.
I20260807 19:57:24.731563 23416 tablet_bootstrap.cc:654] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Neither blocks nor log segments found. Creating new log.
I20260807 19:57:24.733163 23419 tablet_bootstrap.cc:654] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Neither blocks nor log segments found. Creating new log.
I20260807 19:57:24.733232 23416 log.cc:824] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Log is configured to *not* fsync() on all Append() calls
I20260807 19:57:24.734545 23419 log.cc:824] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:57:24.736490 23422 tablet_bootstrap.cc:492] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Bootstrap starting.
I20260807 19:57:24.736719 23416 tablet_bootstrap.cc:492] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: No bootstrap required, opened a new log
I20260807 19:57:24.737007 23416 ts_tablet_manager.cc:1397] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260807 19:57:24.738031 23419 tablet_bootstrap.cc:492] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: No bootstrap required, opened a new log
I20260807 19:57:24.738327 23419 ts_tablet_manager.cc:1397] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 19:57:24.740657 23422 tablet_bootstrap.cc:654] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Neither blocks nor log segments found. Creating new log.
I20260807 19:57:24.741616 23422 log.cc:824] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Log is configured to *not* fsync() on all Append() calls
I20260807 19:57:24.744230 23422 tablet_bootstrap.cc:492] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: No bootstrap required, opened a new log
I20260807 19:57:24.744453 23422 ts_tablet_manager.cc:1397] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260807 19:57:24.747810 23416 raft_consensus.cc:348] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.748255 23416 raft_consensus.cc:374] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:57:24.748363 23416 raft_consensus.cc:729] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35a64306428c4c2db5524f092c7b80f1, State: Initialized, Role: FOLLOWER
I20260807 19:57:24.748821 23419 raft_consensus.cc:348] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.749233 23419 raft_consensus.cc:374] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:57:24.749034 23416 consensus_queue.cc:260] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.749341 23419 raft_consensus.cc:729] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fc5a0ed7ec843618050ad6d168c7d0c, State: Initialized, Role: FOLLOWER
I20260807 19:57:24.750059 23419 consensus_queue.cc:260] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.750259 23129 heartbeater.cc:503] Master 127.5.197.190:33957 was elected leader, sending a full tablet report...
I20260807 19:57:24.751044 23416 ts_tablet_manager.cc:1428] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 19:57:24.753443 23419 ts_tablet_manager.cc:1428] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Time spent starting tablet: real 0.015s user 0.008s sys 0.007s
I20260807 19:57:24.753577 23422 raft_consensus.cc:348] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.754030 23422 raft_consensus.cc:374] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:57:24.754140 23422 raft_consensus.cc:729] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 861dc2b385af470599cf93c5679418b8, State: Initialized, Role: FOLLOWER
I20260807 19:57:24.754729 23422 consensus_queue.cc:260] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.756457 23381 heartbeater.cc:503] Master 127.5.197.190:33957 was elected leader, sending a full tablet report...
I20260807 19:57:24.757102 23422 ts_tablet_manager.cc:1428] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Time spent starting tablet: real 0.013s user 0.001s sys 0.011s
I20260807 19:57:24.779371 23429 raft_consensus.cc:482] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:57:24.779619 23429 raft_consensus.cc:504] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.781219 23429 leader_election.cc:288] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fc5a0ed7ec843618050ad6d168c7d0c (127.5.197.129:39191), 861dc2b385af470599cf93c5679418b8 (127.5.197.131:33609)
I20260807 19:57:24.789121 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.781644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:55293 (local address 127.5.197.131:33609)
0807 19:57:24.781857 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.781863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.782556 (+ 693us) server_negotiation.cc:407] Connection header received
0807 19:57:24.782776 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.782780 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.782838 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.782918 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:57:24.783512 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.784538 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.787080 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.788306 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.788466 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.788541 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.788785 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.788911 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 19:57:24.789305 23440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.781488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:33609 (local address 127.5.197.130:55293)
0807 19:57:24.782457 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:24.782472 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:24.782630 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:24.782954 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:24.782958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:24.782989 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:57:24.783377 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.783387 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.784677 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.784681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.786944 (+ 2263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.786959 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.788509 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.788514 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.788625 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.788649 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:57:24.788740 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 19:57:24.788877 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"mutex_wait_us":51,"spinlock_wait_cycles":21760,"thread_start_us":1263,"threads_started":1}
I20260807 19:57:24.789541 23408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.781636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:39015 (local address 127.5.197.129:39191)
0807 19:57:24.781894 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.781901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.783074 (+ 1173us) server_negotiation.cc:407] Connection header received
0807 19:57:24.783266 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.783270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.783326 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.783396 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:57:24.784054 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.784944 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.787295 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.788617 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.788732 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.788797 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.789175 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.789306 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260807 19:57:24.790028 23438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.781683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39191 (local address 127.5.197.130:39015)
0807 19:57:24.782983 (+ 1300us) negotiation.cc:107] Waiting for socket to connect
0807 19:57:24.782996 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 19:57:24.783137 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:57:24.783427 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:57:24.783432 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:57:24.783455 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:57:24.783890 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.783905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.785068 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.785073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.787157 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:57:24.787167 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.788821 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.788827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:57:24.789001 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.789034 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:57:24.789119 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 19:57:24.789457 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1197,"mutex_wait_us":42,"spinlock_wait_cycles":14976,"thread_start_us":428,"threads_started":1}
I20260807 19:57:24.790143 23283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05f1df49eb264ba58fb9b8e41216a7ff" candidate_uuid: "35a64306428c4c2db5524f092c7b80f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "861dc2b385af470599cf93c5679418b8" is_pre_election: true
I20260807 19:57:24.790719 23283 raft_consensus.cc:2454] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a64306428c4c2db5524f092c7b80f1 in term 0.
I20260807 19:57:24.791105 22798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05f1df49eb264ba58fb9b8e41216a7ff" candidate_uuid: "35a64306428c4c2db5524f092c7b80f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" is_pre_election: true
I20260807 19:57:24.791455 22934 leader_election.cc:302] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a64306428c4c2db5524f092c7b80f1, 861dc2b385af470599cf93c5679418b8; no voters:
I20260807 19:57:24.791826 23429 raft_consensus.cc:2781] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:57:24.791620 22798 raft_consensus.cc:2454] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a64306428c4c2db5524f092c7b80f1 in term 0.
I20260807 19:57:24.791944 23429 raft_consensus.cc:482] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:57:24.792035 23429 raft_consensus.cc:3037] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:57:24.794240 23429 raft_consensus.cc:504] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.794790 23429 leader_election.cc:288] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0fc5a0ed7ec843618050ad6d168c7d0c (127.5.197.129:39191), 861dc2b385af470599cf93c5679418b8 (127.5.197.131:33609)
I20260807 19:57:24.795156 22798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05f1df49eb264ba58fb9b8e41216a7ff" candidate_uuid: "35a64306428c4c2db5524f092c7b80f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c"
I20260807 19:57:24.795230 23283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05f1df49eb264ba58fb9b8e41216a7ff" candidate_uuid: "35a64306428c4c2db5524f092c7b80f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "861dc2b385af470599cf93c5679418b8"
I20260807 19:57:24.795395 22798 raft_consensus.cc:3037] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:57:24.795436 23283 raft_consensus.cc:3037] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:57:24.797693 22798 raft_consensus.cc:2454] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a64306428c4c2db5524f092c7b80f1 in term 1.
I20260807 19:57:24.798019 22936 leader_election.cc:302] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fc5a0ed7ec843618050ad6d168c7d0c, 35a64306428c4c2db5524f092c7b80f1; no voters:
I20260807 19:57:24.798071 23283 raft_consensus.cc:2454] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a64306428c4c2db5524f092c7b80f1 in term 1.
I20260807 19:57:24.798293 23429 raft_consensus.cc:2781] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:57:24.798722 23429 raft_consensus.cc:686] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 1 LEADER]: Becoming Leader. State: Replica: 35a64306428c4c2db5524f092c7b80f1, State: Running, Role: LEADER
I20260807 19:57:24.799216 23429 consensus_queue.cc:237] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } }
I20260807 19:57:24.803462 22511 catalog_manager.cc:5495] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35a64306428c4c2db5524f092c7b80f1 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "35a64306428c4c2db5524f092c7b80f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35a64306428c4c2db5524f092c7b80f1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 33889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 } health_report { overall_health: UNKNOWN } } }
I20260807 19:57:24.842281 23410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.836745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42084 (local address 127.5.197.130:33889)
0807 19:57:24.836916 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.836921 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.836938 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:57:24.837076 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.837080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.837165 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.837311 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:57:24.837734 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.838478 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.840092 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.840531 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.840626 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.841193 (+ 567us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:57:24.841675 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:57:24.841799 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.841890 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.841955 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:57:24.850309 22798 raft_consensus.cc:1261] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 1 FOLLOWER]: Refusing update from remote peer 35a64306428c4c2db5524f092c7b80f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:57:24.850358 23283 raft_consensus.cc:1261] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 1 FOLLOWER]: Refusing update from remote peer 35a64306428c4c2db5524f092c7b80f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:57:24.851421 23441 consensus_queue.cc:1035] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "861dc2b385af470599cf93c5679418b8" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 33609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:57:24.851854 23429 consensus_queue.cc:1035] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fc5a0ed7ec843618050ad6d168c7d0c" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:57:24.880859 22511 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:57:24.881095 22511 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:57:24.884760 22511 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a070f6bfc9964baab6e6305969c698f5: Sending DeleteTablet for 3 replicas of tablet 05f1df49eb264ba58fb9b8e41216a7ff
I20260807 19:57:24.886029 23020 tablet_service.cc:1514] Processing DeleteTablet for tablet 05f1df49eb264ba58fb9b8e41216a7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:57:24 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:42074
I20260807 19:57:24.886001 22760 tablet_service.cc:1514] Processing DeleteTablet for tablet 05f1df49eb264ba58fb9b8e41216a7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:57:24 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:60618
I20260807 19:57:24.886149 23248 tablet_service.cc:1514] Processing DeleteTablet for tablet 05f1df49eb264ba58fb9b8e41216a7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:57:24 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:45310
I20260807 19:57:24.887048 23465 tablet_replica.cc:330] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: stopping tablet replica
I20260807 19:57:24.887195 23464 tablet_replica.cc:330] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: stopping tablet replica
I20260807 19:57:24.887509 23465 raft_consensus.cc:2229] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:57:24.887612 23464 raft_consensus.cc:2229] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:57:24.888049 23465 raft_consensus.cc:2258] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:57:24.888362 23464 raft_consensus.cc:2258] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:57:24.888981 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 22641
I20260807 19:57:24.890105 23465 ts_tablet_manager.cc:1905] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:57:24.890607 23464 ts_tablet_manager.cc:1905] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:57:24.897061 23465 ts_tablet_manager.cc:1918] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:57:24.897301 23465 log.cc:1196] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/05f1df49eb264ba58fb9b8e41216a7ff
I20260807 19:57:24.897838 23464 ts_tablet_manager.cc:1918] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:57:24.897974 23465 ts_tablet_manager.cc:1939] T 05f1df49eb264ba58fb9b8e41216a7ff P 0fc5a0ed7ec843618050ad6d168c7d0c: Deleting consensus metadata
I20260807 19:57:24.898092 23464 log.cc:1196] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/05f1df49eb264ba58fb9b8e41216a7ff
I20260807 19:57:24.898658 23464 ts_tablet_manager.cc:1939] T 05f1df49eb264ba58fb9b8e41216a7ff P 35a64306428c4c2db5524f092c7b80f1: Deleting consensus metadata
I20260807 19:57:24.899812 22484 catalog_manager.cc:4841] TS 0fc5a0ed7ec843618050ad6d168c7d0c (127.5.197.129:39191): tablet 05f1df49eb264ba58fb9b8e41216a7ff (table test-table [id=961ff096d92a4caa8f945bb63d355899]) successfully deleted
I20260807 19:57:24.900768 22483 catalog_manager.cc:4841] TS 35a64306428c4c2db5524f092c7b80f1 (127.5.197.130:33889): tablet 05f1df49eb264ba58fb9b8e41216a7ff (table test-table [id=961ff096d92a4caa8f945bb63d355899]) successfully deleted
I20260807 19:57:24.901397 23467 tablet_replica.cc:330] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: stopping tablet replica
I20260807 19:57:24.901824 23467 raft_consensus.cc:2229] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:57:24.902351 23467 raft_consensus.cc:2258] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:57:24.904219 23467 ts_tablet_manager.cc:1905] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:57:24.909332 23467 ts_tablet_manager.cc:1918] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:57:24.909471 23467 log.cc:1196] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/05f1df49eb264ba58fb9b8e41216a7ff
I20260807 19:57:24.909940 23467 ts_tablet_manager.cc:1939] T 05f1df49eb264ba58fb9b8e41216a7ff P 861dc2b385af470599cf93c5679418b8: Deleting consensus metadata
Aug 07 19:57:24 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:57:24.911777 22483 catalog_manager.cc:4841] TS 861dc2b385af470599cf93c5679418b8 (127.5.197.131:33609): tablet 05f1df49eb264ba58fb9b8e41216a7ff (table test-table [id=961ff096d92a4caa8f945bb63d355899]) successfully deleted
I20260807 19:57:24.918241 23408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:24.890475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60626 (local address 127.5.197.129:39191)
0807 19:57:24.890696 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:24.890702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:24.900756 (+ 10054us) server_negotiation.cc:407] Connection header received
0807 19:57:24.900961 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:24.900966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:24.901042 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:24.901132 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:24.902500 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.903452 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.905403 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:24.906011 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:24.906135 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:24.911639 (+ 5504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:24.911654 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:24.911717 (+ 63us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:24.911767 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:24.914867 (+ 3100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:24.915870 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:24.915880 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:24.915884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:24.916083 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:24.916498 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:24.916504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:24.916507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:24.916976 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:24.917276 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:24.917593 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 19:57:24.917866 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 19:57:24.918882 22865 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:57:25.026440 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 22641
I20260807 19:57:25.059311 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 22888
Aug 07 19:57:25 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:57:25.077107 23410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:25.060186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42098 (local address 127.5.197.130:33889)
0807 19:57:25.060405 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:25.060409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:25.060427 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:57:25.060604 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:25.060608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:25.060672 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:25.060780 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:25.062509 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:25.063325 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:25.065223 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:25.065690 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:25.065807 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:25.070719 (+ 4912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:25.070738 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:25.070753 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:25.070797 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:25.073697 (+ 2900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:25.074530 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:25.074540 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:25.074543 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:25.074748 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:25.075170 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:25.075192 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:25.075195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:25.075738 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:25.076080 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:25.076469 (+ 389us) server_negotiation.cc:299] Negotiation successful
0807 19:57:25.076699 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 19:57:25.078843 23118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:57:25.193817 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 22888
I20260807 19:57:25.218302 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 23138
Aug 07 19:57:25 dist-test-slave-6bbx krb5kdc[21683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:57:25.232950 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:57:25.219042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.5.197.131:33609)
0807 19:57:25.219248 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 19:57:25.219254 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:57:25.219275 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:57:25.219425 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:57:25.219429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:57:25.219492 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:57:25.219588 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:57:25.220943 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:25.221673 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:25.222968 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:57:25.223385 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:57:25.223495 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:57:25.227826 (+ 4331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:57:25.227841 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:57:25.227858 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:57:25.227892 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:57:25.230512 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:25.231168 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:25.231174 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:25.231177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:25.231289 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:57:25.231609 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:57:25.231612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:57:25.231614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:57:25.232035 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:57:25.232273 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 19:57:25.232522 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 19:57:25.232700 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 19:57:25.233598 23367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:57:25.322685 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 23138
I20260807 19:57:25.343981 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 22461
I20260807 19:57:25.345197 22567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:57:25.456365 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 22461
I20260807 19:57:25.486527 5910 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 19:57:25.830384 5910 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 19:57:25.830667 5910 mini_ranger.cc:66] Stopping Ranger...
I20260807 19:57:26.174849 5910 mini_ranger.cc:68] Stopped Ranger
2026-08-07 19:57:26.175 UTC [21732] LOG: received smart shutdown request
2026-08-07 19:57:26.178 UTC [21732] LOG: background worker "logical replication launcher" (PID 21742) exited with exit code 1
2026-08-07 19:57:26.178 UTC [21736] LOG: shutting down
2026-08-07 19:57:26.321 UTC [21732] LOG: database system is shut down
2026-08-07T19:57:26Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51724 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:57:26 dist-test-slave-6bbx krb5kdc[23493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:57:26 dist-test-slave-6bbx krb5kdc[23493](info): set up 2 sockets
Aug 07 19:57:26 dist-test-slave-6bbx krb5kdc[23493](info): commencing operation
krb5kdc: starting...
W20260807 19:57:27.634626 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.008s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:57:27 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:57:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:57:27Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/rangeradmin_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/rangeradmin_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/rangerlookup_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/rangerlookup_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
I20260807 19:57:28.006783 5910 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskQ2gOvL/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/postgres -l logfile start
2026-08-07 19:57:30.315 UTC [23539] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 19:57:30.315 UTC [23539] LOG: listening on IPv4 address "127.5.197.148", port 48991
2026-08-07 19:57:30.319 UTC [23539] LOG: listening on Unix socket "/tmp/.s.PGSQL.48991"
2026-08-07 19:57:30.341 UTC [23544] LOG: database system was shut down at 2026-08-07 19:57:29 UTC
2026-08-07 19:57:30.344 UTC [23539] LOG: database system is ready to accept connections
I20260807 19:57:31.393193 5910 mini_postgres.cc:96] Postgres bound to 48991
2026-08-07 19:57:31.416 UTC [23554] FATAL: database "slave" does not exist
127.5.197.148:48991 - accepting connections
I20260807 19:57:31.417068 5910 mini_ranger.cc:161] Starting Ranger...
I20260807 19:57:31.445773 5910 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 19:57:31.879813 5910 mini_ranger.cc:87] Created ranger Postgres database
I20260807 19:57:31.879913 5910 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-admin
2026-08-07 19:57:32,166 [I] DB FLAVOR :POSTGRES
2026-08-07 19:57:32,167 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:57:32,167 [I] Checking connection..
2026-08-07 19:57:32,167 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 19:57:32,426 [I] Checking connection passed.
2026-08-07 19:57:32,426 [I] --------- Verifying version history table ---------
2026-08-07 19:57:32,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:57:32,683 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:57:32,684 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:57:32,921 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:57:32,921 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 19:57:32,922 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 19:57:33.168 UTC [23668] WARNING: there is no transaction in progress
2026-08-07 19:57:33,176 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 19:57:33,177 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:57:33,426 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 19:57:33,427 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:57:33,427 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 19:57:33,679 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 19:57:33,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6bbx.c.gcp-upstream.internal','N') ;"
2026-08-07 19:57:34,157 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:57:34,420 [I] Table x_portal_user does not exist in database ranger
2026-08-07 19:57:34,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:57:34,681 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 19:57:34,681 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:57:34,920 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:57:35,165 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 19:57:35,165 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 19:57:36.042 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.056 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.072 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.086 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.101 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.116 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.167 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.173 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.187 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.196 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.205 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.219 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.227 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.234 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.240 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36.246 UTC [23854] WARNING: there is no transaction in progress
2026-08-07 19:57:36,825 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 19:57:36,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 19:57:37,051 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 19:57:37,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:57:37,309 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 19:57:37,309 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:57:37,553 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 19:57:37,553 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:57:37,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:57:38,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6bbx.c.gcp-upstream.internal';"
2026-08-07 19:57:38,313 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 19:57:38,313 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 19:57:38,559 [I] DB_PATCHES have already been applied
I20260807 19:57:38.565549 5910 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-admin:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskQ2gOvL/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 19:57:38.565634 5910 mini_ranger.cc:193] Using host: 127.5.197.148
I20260807 19:57:38.586450 5910 mini_ranger.cc:227] Ranger admin URL: http://127.5.197.148:36919
Aug 07, 2026 7:57:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:57:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:57:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 7:57:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 7:57:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 7:57:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 7:57:39 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 19:57:39.789034 5910 mini_ranger.cc:160] Time spent starting Ranger: real 8.372s user 0.004s sys 0.055s
Aug 07, 2026 7:58:00 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 7:58:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 7:58:00 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 7:58:00 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 7:58:00 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 19:58:01.506996 5910 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.5.197.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.5.197.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/rangerkms_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.5.197.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/rangerkms_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.197.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.5.197.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.197.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/HTTP_127.5.197.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 19:58:01 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132681, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 19:58:01.701714 5910 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 19:58:01.725641 5910 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 19:58:02.493721 5910 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 19:58:02.493836 5910 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms
I20260807 19:58:02.493881 5910 mini_ranger_kms.cc:227] Using postgres at 127.5.197.148:48991
2026-08-07 19:58:02,867 [I] DB FLAVOR :POSTGRES
2026-08-07 19:58:02,867 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:58:02,868 [I] Checking connection
2026-08-07 19:58:02,868 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 19:58:03,129 [I] connection success
2026-08-07 19:58:03,129 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 19:58:03,129 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 19:58:03,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 19:58:03,355 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 19:58:03,355 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:58:03,356 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 19:58:03,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.197.148:48991/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 19:58:03,618 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 19:58:04.080588 5910 mini_ranger_kms.cc:310] Created kms service
I20260807 19:58:04.237344 5910 mini_ranger_kms.cc:326] Created kudu user
I20260807 19:58:04.283483 5910 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 19:58:04 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132681, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:04.665562 5910 mini_ranger_kms.cc:384] Added ranger policy
I20260807 19:58:04.665849 5910 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms:/tmp/dist-test-taskQ2gOvL/build/asan/bin/postgresql.jar:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskQ2gOvL/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 19:58:04.665897 5910 mini_ranger_kms.cc:240] Using host: 127.5.197.148
I20260807 19:58:04.693154 5910 mini_ranger_kms.cc:276] Ranger KMS PID: 24149
I20260807 19:58:04.693272 5910 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.5.197.148:34271
Aug 07, 2026 7:58:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:58:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:58:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 7:58:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 7:58:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 7:58:06 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 19:58:07 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132687, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.197.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:07.201858 5910 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.500s user 0.087s sys 0.323s
I20260807 19:58:07.202112 5910 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 19:58:07.202332 5910 mini_ranger_kms.cc:401] 127.5.197.148:34271/kms/v1/keys
Aug 07 19:58:07 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132687, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.197.148@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
Aug 07 19:58:07 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132687, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.197.148@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
Aug 07 19:58:10 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:58:10.155993 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37441
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37441
--ranger_config_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:10.495467 24231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:10.495806 24231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:10.495942 24231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:10.502985 24231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:10.503096 24231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:10.503175 24231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:10.503259 24231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:10.503325 24231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:10.513187 24231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
--ranger_kms_url=127.5.197.148:34271/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37441
--ranger_config_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:10.514376 24231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:10.515688 24231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:10.526737 24241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:10.526822 24242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:10.526854 24244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:10.527778 24231 server_base.cc:1034] running on GCE node
I20260807 19:58:10.528520 24231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:10.529800 24231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:10.531001 24231 hybrid_clock.cc:648] HybridClock initialized: now 1786132690530963 us; error 32 us; skew 500 ppm
I20260807 19:58:10.531325 24231 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:10 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132690, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:10.534279 24231 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:10.535614 24231 webserver.cc:460] Webserver started at http://127.5.197.190:36553/ using document root <none> and password file <none>
I20260807 19:58:10.536252 24231 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:10.536365 24231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:10.536641 24231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:58:10 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132690, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:10.584813 24231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "325d6552b8534d4288b54e26fffdf5df"
format_stamp: "Formatted at 2026-08-07 19:58:10 on dist-test-slave-6bbx"
server_key: "76322eaa1f110ccc6cf6922c908b2429"
server_key_iv: "af0457703c95ea54e4a94b0e293e8b19"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:10.585800 24231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "325d6552b8534d4288b54e26fffdf5df"
format_stamp: "Formatted at 2026-08-07 19:58:10 on dist-test-slave-6bbx"
server_key: "76322eaa1f110ccc6cf6922c908b2429"
server_key_iv: "af0457703c95ea54e4a94b0e293e8b19"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:10.591400 24231 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:58:10.607077 24252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:10.608530 24231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:58:10.608700 24231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "325d6552b8534d4288b54e26fffdf5df"
format_stamp: "Formatted at 2026-08-07 19:58:10 on dist-test-slave-6bbx"
server_key: "76322eaa1f110ccc6cf6922c908b2429"
server_key_iv: "af0457703c95ea54e4a94b0e293e8b19"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:10.608906 24231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:10.629966 24231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:10.633806 24231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:10.634092 24231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:10.653055 24231 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37441
I20260807 19:58:10.653061 24339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37441 every 8 connection(s)
I20260807 19:58:10.654407 24231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:10.655059 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 24231
I20260807 19:58:10.655261 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:58:10.656179 5910 external_mini_cluster.cc:1428] Setting key 5c180480353b26e646dcb806baa10e03
I20260807 19:58:10.659217 24340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:10.670059 24340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Bootstrap starting.
I20260807 19:58:10.673849 24340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:10.675086 24340 log.cc:824] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:10.678146 24340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: No bootstrap required, opened a new log
Aug 07 19:58:10 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:10.687403 24340 raft_consensus.cc:348] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:10.687875 24340 raft_consensus.cc:374] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:10.687986 24340 raft_consensus.cc:729] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 325d6552b8534d4288b54e26fffdf5df, State: Initialized, Role: FOLLOWER
I20260807 19:58:10.688828 24340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:10.689222 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:10.658601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41304 (local address 127.5.197.190:37441)
0807 19:58:10.668234 (+ 9633us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:10.668250 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:10.668658 (+ 408us) server_negotiation.cc:407] Connection header received
0807 19:58:10.671045 (+ 2387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:10.671072 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:10.671558 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:10.672038 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:10.673209 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:10.675156 (+ 1947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:10.676412 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:10.677376 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:10.677544 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:10.681251 (+ 3707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:10.681262 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:10.681282 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:10.681327 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:10.685051 (+ 3724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:10.685661 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:10.685669 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:10.685677 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:10.685872 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:10.686179 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:10.686184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:10.686187 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:10.686870 (+ 683us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:10.687173 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:10.687462 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 19:58:10.687877 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9387,"thread_start_us":9126,"threads_started":1}
I20260807 19:58:10.689201 24351 raft_consensus.cc:482] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:58:10.689483 24351 raft_consensus.cc:504] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:10.689150 24340 raft_consensus.cc:388] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:58:10.690086 24340 raft_consensus.cc:482] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:58:10.690040 24351 leader_election.cc:302] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 325d6552b8534d4288b54e26fffdf5df; no voters:
I20260807 19:58:10.690224 24340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:10.691951 24351 leader_election.cc:288] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260807 19:58:10.692955 24340 raft_consensus.cc:504] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:10.693156 24340 leader_election.cc:302] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 325d6552b8534d4288b54e26fffdf5df; no voters:
I20260807 19:58:10.693225 24353 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 19:58:10.693382 24340 leader_election.cc:288] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:58:10.693640 24351 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:10.695173 24340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:10.695936 24351 raft_consensus.cc:686] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 LEADER]: Becoming Leader. State: Replica: 325d6552b8534d4288b54e26fffdf5df, State: Running, Role: LEADER
I20260807 19:58:10.696524 24351 consensus_queue.cc:237] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:10.698799 24354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "325d6552b8534d4288b54e26fffdf5df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } } }
I20260807 19:58:10.698740 24353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 325d6552b8534d4288b54e26fffdf5df. Latest consensus state: current_term: 1 leader_uuid: "325d6552b8534d4288b54e26fffdf5df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } } }
I20260807 19:58:10.699198 24353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:10.699193 24354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:10.700114 24364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:10.705300 24364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:10.705932 24340 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 19:58:10.725574 24364 catalog_manager.cc:1347] Generated new cluster ID: bdb07bf8793447c39ca915ad85523d0d
I20260807 19:58:10.725711 24364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:58:10.739480 24364 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:58:10.741532 24364 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:58:10.755252 24364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Generated new TSK 0
I20260807 19:58:10.756356 24364 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:58:11.489672 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37441
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:58:11 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132691, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 19:58:11.935077 24414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:11.935457 24414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:11.935693 24414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:11.947182 24414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:11.947351 24414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:11.947570 24414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:58:11.963179 24414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.5.197.148:34271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:11.964985 24414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:11.966800 24414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:11.984812 24433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:11.986078 24435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:11.987887 24439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:11.988343 24414 server_base.cc:1034] running on GCE node
I20260807 19:58:11.988967 24414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:11.989953 24414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:11.991178 24414 hybrid_clock.cc:648] HybridClock initialized: now 1786132691991113 us; error 57 us; skew 500 ppm
I20260807 19:58:11.991492 24414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:11 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132691, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:11.995223 24414 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:58:11.996879 24414 webserver.cc:460] Webserver started at http://127.5.197.129:41649/ using document root <none> and password file <none>
I20260807 19:58:11.997615 24414 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:11.997722 24414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:11.998045 24414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:58:11 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132691, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:12.016902 24414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "e2fe83e96a744291a937e4b047e17f16"
format_stamp: "Formatted at 2026-08-07 19:58:12 on dist-test-slave-6bbx"
server_key: "7021a72a1c3d786413ab5d75955a540a"
server_key_iv: "4db1ec123b40752017c8c3318fa80e93"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:12.018079 24414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "e2fe83e96a744291a937e4b047e17f16"
format_stamp: "Formatted at 2026-08-07 19:58:12 on dist-test-slave-6bbx"
server_key: "7021a72a1c3d786413ab5d75955a540a"
server_key_iv: "4db1ec123b40752017c8c3318fa80e93"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:12.045622 24414 fs_manager.cc:691] Time spent creating directory manager: real 0.027s user 0.007s sys 0.011s
I20260807 19:58:12.076258 24448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:12.078274 24414 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.008s sys 0.002s
I20260807 19:58:12.078549 24414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "e2fe83e96a744291a937e4b047e17f16"
format_stamp: "Formatted at 2026-08-07 19:58:12 on dist-test-slave-6bbx"
server_key: "7021a72a1c3d786413ab5d75955a540a"
server_key_iv: "4db1ec123b40752017c8c3318fa80e93"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:12.078918 24414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:12.135692 24414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:12.143635 24414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:12.144101 24414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:12.161830 24414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:12.170173 24414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:12.170399 24414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 19:58:12.170650 24414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:12.170790 24414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:58:12 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132691, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:12.422701 24414 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:35205
I20260807 19:58:12.422726 24627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:35205 every 8 connection(s)
I20260807 19:58:12.424261 24414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:58:12.427173 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 24414
I20260807 19:58:12.427362 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:58:12.428134 5910 external_mini_cluster.cc:1428] Setting key 5a0b8d003617524e3981775fbf707e20
Aug 07 19:58:12 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132691, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:12.466876 24632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:12.427245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:52529 (local address 127.5.197.190:37441)
0807 19:58:12.440908 (+ 13663us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:12.440914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:12.440932 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:58:12.441457 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:12.441464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:12.441565 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:12.441668 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:12.443886 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:12.444920 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:12.447538 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:12.448145 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:12.448237 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:12.459070 (+ 10833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:12.459078 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:12.459082 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:12.459126 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:12.462835 (+ 3709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:12.463876 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:12.463882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:12.463886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:12.464043 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:12.464636 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:12.464641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:12.464645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:12.465010 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:12.465142 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:12.466211 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0807 19:58:12.466456 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13535,"thread_start_us":13387,"threads_started":1}
I20260807 19:58:12.469667 24633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:12.427979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37441 (local address 127.5.197.129:52529)
0807 19:58:12.437077 (+ 9098us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:12.437142 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:12.441034 (+ 3892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:12.442111 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:12.442123 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:12.442816 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:12.443651 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:12.443701 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:12.445601 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:12.445605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:12.447376 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:12.447391 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:12.448590 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:12.448597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:12.448875 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:12.449631 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:12.449665 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:12.458750 (+ 9085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:12.463051 (+ 4301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:12.463062 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:12.463080 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:12.463728 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:12.464191 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:12.464196 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:12.464200 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:12.464496 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:12.465248 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:12.465257 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:12.465733 (+ 476us) client_negotiation.cc:769] Sending connection context
0807 19:58:12.467450 (+ 1717us) client_negotiation.cc:240] Negotiation successful
0807 19:58:12.468090 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8744,"thread_start_us":11549,"threads_started":1}
I20260807 19:58:12.472138 24629 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37441
I20260807 19:58:12.472458 24629 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:12.473382 24629 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
I20260807 19:58:12.476058 24278 ts_manager.cc:194] Registered new tserver with Master: e2fe83e96a744291a937e4b047e17f16 (127.5.197.129:35205)
I20260807 19:58:12.478107 24278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:52529
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
W20260807 19:58:12.555516 5910 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.5.197.130: real 0.113s user 0.002s sys 0.024s
I20260807 19:58:12.556567 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37441
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:58:12 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132691, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
W20260807 19:58:13.058422 24637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:13.058710 24637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:13.058858 24637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:13.066043 24637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:13.066143 24637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:13.066291 24637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:58:13.076145 24637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.5.197.148:34271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:13.077448 24637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:13.078958 24637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:13.093458 24667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:13.093504 24664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:13.094086 24663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:13.094230 24637 server_base.cc:1034] running on GCE node
I20260807 19:58:13.094833 24637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:13.095829 24637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:13.097081 24637 hybrid_clock.cc:648] HybridClock initialized: now 1786132693097032 us; error 42 us; skew 500 ppm
I20260807 19:58:13.097362 24637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:13 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132693, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:13.100524 24637 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:58:13.101991 24637 webserver.cc:460] Webserver started at http://127.5.197.130:36223/ using document root <none> and password file <none>
I20260807 19:58:13.102648 24637 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:13.102748 24637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:13.103008 24637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:58:13 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132693, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:13.117605 24637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "2aa336d186b3477d84c6d59966f7c6df"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3a3039d5156026b8ae00ef7cf96f748f"
server_key_iv: "1e976ae29d01737852bf80d9c3060f91"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:13.118744 24637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "2aa336d186b3477d84c6d59966f7c6df"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3a3039d5156026b8ae00ef7cf96f748f"
server_key_iv: "1e976ae29d01737852bf80d9c3060f91"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:13.125821 24637 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 19:58:13.140692 24681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:13.142262 24637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:58:13.142426 24637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "2aa336d186b3477d84c6d59966f7c6df"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3a3039d5156026b8ae00ef7cf96f748f"
server_key_iv: "1e976ae29d01737852bf80d9c3060f91"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:13.142648 24637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:13.158366 24637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:13.161914 24637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:13.162202 24637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:13.163159 24637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:13.164556 24637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:13.164628 24637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:13.164752 24637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:13.164803 24637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:13.224529 24637 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41407
I20260807 19:58:13.224611 24885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41407 every 8 connection(s)
I20260807 19:58:13.225965 24637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:58:13.232774 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 24637
I20260807 19:58:13.232919 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:58:13.233371 5910 external_mini_cluster.cc:1428] Setting key 101a13ff3f4a0c92842ac556d3455ea5
Aug 07 19:58:13 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132693, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:13.251901 24893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:13.229206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:46191 (local address 127.5.197.190:37441)
0807 19:58:13.230066 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:13.230072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:13.231344 (+ 1272us) server_negotiation.cc:407] Connection header received
0807 19:58:13.234085 (+ 2741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:13.234092 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:13.234197 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:13.234292 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:13.236258 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.237138 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.239125 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.239710 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.239821 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:13.244296 (+ 4475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:13.244302 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:13.244306 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:13.244338 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:13.248067 (+ 3729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:13.248937 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:13.248943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:13.248946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:13.249150 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:13.249574 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:13.249579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:13.249582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:13.250149 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:13.250298 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:13.251074 (+ 776us) server_negotiation.cc:299] Negotiation successful
0807 19:58:13.251340 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":532,"threads_started":1}
I20260807 19:58:13.252774 24895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:13.229902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37441 (local address 127.5.197.130:46191)
0807 19:58:13.231155 (+ 1253us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:13.231209 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:13.233802 (+ 2593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:13.234612 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:13.234621 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:13.235190 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:13.236080 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:13.236101 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.237298 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.237302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:13.238981 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:13.238994 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.240022 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.240032 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:13.240357 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:13.241035 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:13.241058 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:13.244039 (+ 2981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:13.248201 (+ 4162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:13.248208 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:13.248221 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:13.248780 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:13.249279 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:13.249282 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:13.249284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:13.249459 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:13.250313 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:13.250321 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:13.250652 (+ 331us) client_negotiation.cc:769] Sending connection context
0807 19:58:13.250929 (+ 277us) client_negotiation.cc:240] Negotiation successful
0807 19:58:13.251368 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"thread_start_us":631,"threads_started":1}
I20260807 19:58:13.254236 24886 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37441
I20260807 19:58:13.254617 24886 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:13.255889 24886 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
I20260807 19:58:13.257848 24278 ts_manager.cc:194] Registered new tserver with Master: 2aa336d186b3477d84c6d59966f7c6df (127.5.197.130:41407)
I20260807 19:58:13.259035 24278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:46191
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:58:13.303061 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37441
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:58:13.482101 24629 heartbeater.cc:503] Master 127.5.197.190:37441 was elected leader, sending a full tablet report...
W20260807 19:58:13.690157 24901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:13.690423 24901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:13.690528 24901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:13.697685 24901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:13.697782 24901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:13.697888 24901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:58:13.707357 24901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.5.197.148:34271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:13.708600 24901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:13.709867 24901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:13.723512 24909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:13.723472 24911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:13.723551 24908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:13.724433 24901 server_base.cc:1034] running on GCE node
I20260807 19:58:13.725032 24901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:13.725934 24901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:13.727145 24901 hybrid_clock.cc:648] HybridClock initialized: now 1786132693727096 us; error 34 us; skew 500 ppm
I20260807 19:58:13.727452 24901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:13 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132693, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:13.734529 24901 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:58:13.735984 24901 webserver.cc:460] Webserver started at http://127.5.197.131:37145/ using document root <none> and password file <none>
I20260807 19:58:13.736645 24901 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:13.736771 24901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:13.737074 24901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:58:13 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132693, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:13.751252 24901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "e6dfbcb63565412f8d9e31a77a7a09be"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3db6a044168637b6590235fab33d2e0c"
server_key_iv: "41f32afbcf542048c83275b4131559cd"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:13.752130 24901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "e6dfbcb63565412f8d9e31a77a7a09be"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3db6a044168637b6590235fab33d2e0c"
server_key_iv: "41f32afbcf542048c83275b4131559cd"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:13.757360 24901 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:58:13.773929 24935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:13.775698 24901 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:58:13.775897 24901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "e6dfbcb63565412f8d9e31a77a7a09be"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3db6a044168637b6590235fab33d2e0c"
server_key_iv: "41f32afbcf542048c83275b4131559cd"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:13.776149 24901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:13.807847 24901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:13.812530 24901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:13.812796 24901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:13.813759 24901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:13.815104 24901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:13.815177 24901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:13.815267 24901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:13.815311 24901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:13.845108 24901 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39711
I20260807 19:58:13.845147 25105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39711 every 8 connection(s)
I20260807 19:58:13.846405 24901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:58:13.852806 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 24901
I20260807 19:58:13.852952 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:58:13.853385 5910 external_mini_cluster.cc:1428] Setting key 179c8a6e3cac1d9c73281fd099170426
Aug 07 19:58:13 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132693, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:13.865526 25110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:13.849010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:41097 (local address 127.5.197.190:37441)
0807 19:58:13.849516 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:13.849521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:13.850352 (+ 831us) server_negotiation.cc:407] Connection header received
0807 19:58:13.852235 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:13.852241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:13.852334 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:13.852435 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:13.853923 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.854824 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.856553 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.856956 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.857065 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:13.860193 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:13.860198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:13.860202 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:13.860242 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:13.862584 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:13.863263 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:13.863267 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:13.863269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:13.863392 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:13.863832 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:13.863836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:13.863838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:13.864098 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:13.864241 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:13.864919 (+ 678us) server_negotiation.cc:299] Negotiation successful
0807 19:58:13.865139 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":266,"threads_started":1}
I20260807 19:58:13.866372 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:13.849473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37441 (local address 127.5.197.131:41097)
0807 19:58:13.850182 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:13.850229 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:13.851965 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:13.852677 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:13.852685 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:13.853158 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:13.853755 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:13.853773 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.854974 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.854978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:13.856414 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:13.856434 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.857177 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.857185 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:13.857403 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:13.857968 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:13.857994 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:13.859987 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:13.862715 (+ 2728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:13.862731 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:13.862747 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:13.863132 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:13.863498 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:13.863503 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:13.863506 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:13.863711 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:13.864225 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:13.864233 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:13.864549 (+ 316us) client_negotiation.cc:769] Sending connection context
0807 19:58:13.864795 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 19:58:13.865269 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":286,"threads_started":1}
I20260807 19:58:13.867741 25106 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37441
I20260807 19:58:13.868010 25106 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:13.868680 25106 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
I20260807 19:58:13.870034 24277 ts_manager.cc:194] Registered new tserver with Master: e6dfbcb63565412f8d9e31a77a7a09be (127.5.197.131:39711)
I20260807 19:58:13.870891 24277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:41097
I20260807 19:58:13.880667 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:58:13.882443 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 24414
Aug 07 19:58:13 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:58:13.898589 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:13.883376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46496 (local address 127.5.197.129:35205)
0807 19:58:13.884043 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:13.884049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:13.884073 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:58:13.884129 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:13.884134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:13.884318 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:13.884443 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:13.885956 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.887001 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.888639 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:13.889312 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:13.889435 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:13.893475 (+ 4040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:13.893487 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:13.893500 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:13.893538 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:13.896120 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:13.896763 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:13.896770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:13.896773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:13.896924 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:13.897214 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:13.897217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:13.897219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:13.897577 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:13.897804 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:13.898054 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 19:58:13.898284 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":386,"threads_started":1}
I20260807 19:58:13.899814 24621 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:13.981537 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 24414
I20260807 19:58:14.001931 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 24637
Aug 07 19:58:14 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:58:14.022423 25119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:14.002873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43160 (local address 127.5.197.130:41407)
0807 19:58:14.003394 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:14.003401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:14.003425 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:58:14.003487 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:14.003494 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:14.003744 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:14.003893 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:14.005170 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:14.006189 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:14.007651 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:14.008360 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:14.008479 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:14.016853 (+ 8374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:14.016865 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:14.016880 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:14.016925 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:14.019606 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:14.020288 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:14.020295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:14.020298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:14.020435 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:14.020802 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:14.020806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:14.020808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:14.021156 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:14.021459 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:14.021780 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 19:58:14.022054 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":256,"threads_started":1}
I20260807 19:58:14.023690 24879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:14.106628 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 24637
I20260807 19:58:14.127522 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 24901
Aug 07 19:58:14 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:58:14.143852 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:14.128697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46776 (local address 127.5.197.131:39711)
0807 19:58:14.129428 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:14.129436 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:14.129474 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:58:14.129559 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:14.129568 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:14.129849 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:14.129982 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:14.131225 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:14.132380 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:14.133598 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:14.134179 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:14.134291 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:14.138435 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:14.138446 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:14.138462 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:14.138494 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:14.141201 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:14.141803 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:14.141810 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:14.141812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:14.141945 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:14.142255 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:14.142258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:14.142260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:14.142577 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:14.142818 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:14.143101 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 19:58:14.143319 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":368,"threads_started":1}
I20260807 19:58:14.145196 25098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:14.226302 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 24901
I20260807 19:58:14.246716 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 24231
I20260807 19:58:14.247998 24332 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:14.359607 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 24231
I20260807 19:58:14.390163 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37441
--webserver_interface=127.5.197.190
--webserver_port=36553
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37441
--ranger_config_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:14.714915 25128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:14.715198 25128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:14.715293 25128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:14.722357 25128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:14.722460 25128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:14.722510 25128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:14.722569 25128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:14.722616 25128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:14.732332 25128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37441
--ranger_config_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=36553
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:14.733503 25128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:14.734750 25128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:14.746104 25139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:14.746187 25138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:14.746151 25142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:14.746999 25128 server_base.cc:1034] running on GCE node
I20260807 19:58:14.747748 25128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:14.749055 25128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:14.750290 25128 hybrid_clock.cc:648] HybridClock initialized: now 1786132694750237 us; error 35 us; skew 500 ppm
I20260807 19:58:14.750639 25128 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:14 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132694, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:14.753762 25128 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:14.755182 25128 webserver.cc:460] Webserver started at http://127.5.197.190:36553/ using document root <none> and password file <none>
I20260807 19:58:14.755897 25128 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:14.756011 25128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:58:14 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132694, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:14.797750 25128 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:58:14.800740 25154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:14.802069 25128 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:58:14.802259 25128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "325d6552b8534d4288b54e26fffdf5df"
format_stamp: "Formatted at 2026-08-07 19:58:10 on dist-test-slave-6bbx"
server_key: "76322eaa1f110ccc6cf6922c908b2429"
server_key_iv: "af0457703c95ea54e4a94b0e293e8b19"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:14.803222 25128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:14.817611 25128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:14.821026 25128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:14.821276 25128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:14.838359 25128 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37441
I20260807 19:58:14.838380 25236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37441 every 8 connection(s)
I20260807 19:58:14.839761 25128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:14.845753 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 25128
I20260807 19:58:14.846860 25237 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:58:14.846840 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:35205
--local_ip_for_outbound_sockets=127.5.197.129
--tserver_master_addrs=127.5.197.190:37441
--webserver_port=41649
--webserver_interface=127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:58:14.851154 25237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Bootstrap starting.
I20260807 19:58:14.871317 25237 log.cc:824] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:14.880131 25237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:58:14.880622 25237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Bootstrap complete.
I20260807 19:58:14.889350 25237 raft_consensus.cc:348] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:14.890228 25237 raft_consensus.cc:729] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 325d6552b8534d4288b54e26fffdf5df, State: Initialized, Role: FOLLOWER
I20260807 19:58:14.890813 25237 consensus_queue.cc:260] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:14.891016 25237 raft_consensus.cc:388] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:58:14.891122 25237 raft_consensus.cc:482] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:58:14.891290 25237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:58:14.895072 25237 raft_consensus.cc:504] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:14.895532 25237 leader_election.cc:302] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 325d6552b8534d4288b54e26fffdf5df; no voters:
I20260807 19:58:14.896152 25237 leader_election.cc:288] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:58:14.896303 25246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:58:14.897403 25246 raft_consensus.cc:686] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [term 2 LEADER]: Becoming Leader. State: Replica: 325d6552b8534d4288b54e26fffdf5df, State: Running, Role: LEADER
I20260807 19:58:14.898017 25246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } }
I20260807 19:58:14.898247 25237 sys_catalog.cc:564] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:14.900738 25250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 325d6552b8534d4288b54e26fffdf5df. Latest consensus state: current_term: 2 leader_uuid: "325d6552b8534d4288b54e26fffdf5df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } } }
I20260807 19:58:14.901103 25250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:14.901872 25249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "325d6552b8534d4288b54e26fffdf5df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "325d6552b8534d4288b54e26fffdf5df" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37441 } } }
I20260807 19:58:14.902204 25249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:14.912588 25254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:14.918687 25254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:14.920265 25254 catalog_manager.cc:1259] Loaded cluster ID: bdb07bf8793447c39ca915ad85523d0d
I20260807 19:58:14.920429 25254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:58:14.924772 25254 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:58:14.926461 25254 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Loaded TSK: 0
I20260807 19:58:14.928115 25254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:58:14.932880 25237 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260807 19:58:15.289953 25239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:15.290270 25239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:15.290434 25239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:15.301116 25239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:15.301249 25239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:15.301429 25239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:58:15.315322 25239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:35205
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=41649
--tserver_master_addrs=127.5.197.190:37441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:15.317301 25239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:15.319063 25239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:15.359071 25299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:15.360036 25302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:15.365926 25239 server_base.cc:1034] running on GCE node
W20260807 19:58:15.366092 25306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:15.366950 25239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:15.371963 25239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:15.373246 25239 hybrid_clock.cc:648] HybridClock initialized: now 1786132695373180 us; error 61 us; skew 500 ppm
I20260807 19:58:15.373586 25239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:15 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132695, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:15.378422 25239 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:58:15.387974 25239 webserver.cc:460] Webserver started at http://127.5.197.129:41649/ using document root <none> and password file <none>
I20260807 19:58:15.388886 25239 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:15.389038 25239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:58:15 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132695, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:15.437727 25239 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.007s sys 0.003s
I20260807 19:58:15.448062 25319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:15.449877 25239 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.005s
I20260807 19:58:15.450138 25239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "e2fe83e96a744291a937e4b047e17f16"
format_stamp: "Formatted at 2026-08-07 19:58:12 on dist-test-slave-6bbx"
server_key: "7021a72a1c3d786413ab5d75955a540a"
server_key_iv: "4db1ec123b40752017c8c3318fa80e93"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:15.451282 25239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:15.492255 25239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:15.496480 25239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:15.496758 25239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:15.497910 25239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:15.499576 25239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:15.499706 25239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:15.499821 25239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:15.499908 25239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:15.576304 25239 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:35205
I20260807 19:58:15.576340 25501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:35205 every 8 connection(s)
I20260807 19:58:15.577917 25239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:58:15.584160 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 25239
I20260807 19:58:15.585016 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:41407
--local_ip_for_outbound_sockets=127.5.197.130
--tserver_master_addrs=127.5.197.190:37441
--webserver_port=36223
--webserver_interface=127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:58:15 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132695, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:15.635200 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:15.581802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37441 (local address 127.5.197.129:39425)
0807 19:58:15.602122 (+ 20320us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:15.602213 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:15.607731 (+ 5518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:15.609992 (+ 2261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:15.610004 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:15.610715 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:15.611582 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:15.611612 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:15.614169 (+ 2557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:15.614175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:15.619735 (+ 5560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:15.619753 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:15.621617 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:15.621625 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:15.621918 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:15.622811 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:15.622845 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:15.625642 (+ 2797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:15.630051 (+ 4409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:15.630060 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:15.630077 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:15.630653 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:15.631239 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:15.631244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:15.631248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:15.631470 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:15.632477 (+ 1007us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:15.632485 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:15.632874 (+ 389us) client_negotiation.cc:769] Sending connection context
0807 19:58:15.633201 (+ 327us) client_negotiation.cc:240] Negotiation successful
0807 19:58:15.633790 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19353,"thread_start_us":21757,"threads_started":1}
I20260807 19:58:15.637513 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:15.583118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:39425 (local address 127.5.197.190:37441)
0807 19:58:15.589887 (+ 6769us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:15.589908 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:15.602393 (+ 12485us) server_negotiation.cc:407] Connection header received
0807 19:58:15.608504 (+ 6111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:15.608522 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:15.609028 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:15.609442 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:15.611858 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:15.613757 (+ 1899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:15.619926 (+ 6169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:15.620973 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:15.621134 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:15.625977 (+ 4843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:15.625988 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:15.626010 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:15.626074 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:15.629875 (+ 3801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:15.630882 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:15.630892 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:15.630900 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:15.631118 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:15.631610 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:15.631616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:15.631619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:15.632337 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:15.632565 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:15.635884 (+ 3319us) server_negotiation.cc:299] Negotiation successful
0807 19:58:15.636326 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6470,"thread_start_us":6431,"threads_started":1}
I20260807 19:58:15.641590 25502 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37441
I20260807 19:58:15.641924 25502 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:15.642783 25502 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
W20260807 19:58:15.646193 25502 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:37441 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 19:58:15.646443 25502 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:15.646714 25502 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
I20260807 19:58:15.648025 25502 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:15.648367 25502 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
W20260807 19:58:15.649478 25502 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:58:16.000447 25507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:16.000844 25507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:16.001061 25507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:16.009420 25507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:16.009544 25507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:16.009728 25507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:58:16.024672 25507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:41407
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=36223
--tserver_master_addrs=127.5.197.190:37441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:16.026407 25507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:16.028044 25507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:16.043923 25535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:16.049091 25534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:16.049836 25507 server_base.cc:1034] running on GCE node
W20260807 19:58:16.050272 25538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:16.051115 25507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:16.064038 25507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:16.067548 25507 hybrid_clock.cc:648] HybridClock initialized: now 1786132696067409 us; error 137 us; skew 500 ppm
I20260807 19:58:16.068146 25507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:16.072660 25507 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:58:16.078090 25507 webserver.cc:460] Webserver started at http://127.5.197.130:36223/ using document root <none> and password file <none>
I20260807 19:58:16.079068 25507 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:16.079218 25507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:16.111871 25507 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.008s sys 0.001s
I20260807 19:58:16.115072 25556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:16.116601 25507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:16.116778 25507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "2aa336d186b3477d84c6d59966f7c6df"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3a3039d5156026b8ae00ef7cf96f748f"
server_key_iv: "1e976ae29d01737852bf80d9c3060f91"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:16.117841 25507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:16.145000 25507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:16.149252 25507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:16.149534 25507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:16.150657 25507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:16.152406 25507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:16.152568 25507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 19:58:16.152732 25507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:16.152822 25507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:16.221846 25752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41407 every 8 connection(s)
I20260807 19:58:16.222498 25507 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41407
I20260807 19:58:16.224092 25507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:58:16.233791 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 25507
I20260807 19:58:16.234593 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.197.148:34271/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:39711
--local_ip_for_outbound_sockets=127.5.197.131
--tserver_master_addrs=127.5.197.190:37441
--webserver_port=37145
--webserver_interface=127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:39781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:16.249404 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:16.227159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:46189 (local address 127.5.197.190:37441)
0807 19:58:16.227699 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:16.227706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:16.228830 (+ 1124us) server_negotiation.cc:407] Connection header received
0807 19:58:16.230764 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:16.230769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:16.230861 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:16.230957 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:16.232467 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.233305 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.235700 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.236361 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.236462 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:16.241053 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:16.241060 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:16.241065 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:16.241109 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:16.244587 (+ 3478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:16.245358 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:16.245362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:16.245365 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:16.245492 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:16.245946 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:16.245951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:16.245954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:16.246327 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:16.246468 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:16.248777 (+ 2309us) server_negotiation.cc:299] Negotiation successful
0807 19:58:16.249027 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":256,"threads_started":1}
I20260807 19:58:16.250303 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:16.227848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37441 (local address 127.5.197.130:46189)
0807 19:58:16.228643 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:16.228682 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:16.230478 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:16.231226 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:16.231236 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:16.231660 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:16.232288 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:16.232310 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.233508 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.233513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:16.235505 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:16.235521 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.236834 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.236840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:16.237139 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:16.237943 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:16.237978 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:16.240744 (+ 2766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:16.244735 (+ 3991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:16.244745 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:16.244762 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:16.245217 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:16.245607 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:16.245611 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:16.245614 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:16.245814 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:16.247771 (+ 1957us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:16.247780 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:16.248245 (+ 465us) client_negotiation.cc:769] Sending connection context
0807 19:58:16.248615 (+ 370us) client_negotiation.cc:240] Negotiation successful
0807 19:58:16.249133 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":325,"threads_started":1}
I20260807 19:58:16.251914 25754 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37441
I20260807 19:58:16.252231 25754 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:16.252970 25754 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
I20260807 19:58:16.255088 25182 ts_manager.cc:194] Registered new tserver with Master: 2aa336d186b3477d84c6d59966f7c6df (127.5.197.130:41407)
I20260807 19:58:16.257555 25182 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:46189
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:16.649629 25502 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:16.650096 25502 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
I20260807 19:58:16.651404 25182 ts_manager.cc:194] Registered new tserver with Master: e2fe83e96a744291a937e4b047e17f16 (127.5.197.129:35205)
I20260807 19:58:16.652612 25182 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:39425
W20260807 19:58:16.711380 25758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:16.711696 25758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:16.711869 25758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:16.719038 25758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:16.719159 25758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:16.719326 25758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:58:16.729315 25758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:39781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.197.148:34271/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:39711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=37145
--tserver_master_addrs=127.5.197.190:37441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:16.730655 25758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:16.732105 25758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:16.747803 25768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:16.747784 25767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:16.756253 25770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:16.756619 25758 server_base.cc:1034] running on GCE node
I20260807 19:58:16.757432 25758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:16.759953 25758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:16.761260 25758 hybrid_clock.cc:648] HybridClock initialized: now 1786132696761192 us; error 59 us; skew 500 ppm
I20260807 19:58:16.761597 25758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:16.764941 25758 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:58:16.769794 25758 webserver.cc:460] Webserver started at http://127.5.197.131:37145/ using document root <none> and password file <none>
I20260807 19:58:16.770537 25758 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:16.770723 25758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:16.796964 25758 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.003s sys 0.001s
I20260807 19:58:16.812391 25782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:16.814545 25758 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.003s sys 0.012s
I20260807 19:58:16.814744 25758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "e6dfbcb63565412f8d9e31a77a7a09be"
format_stamp: "Formatted at 2026-08-07 19:58:13 on dist-test-slave-6bbx"
server_key: "3db6a044168637b6590235fab33d2e0c"
server_key_iv: "41f32afbcf542048c83275b4131559cd"
server_key_version: "kuduclusterkey@0"
I20260807 19:58:16.816597 25758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:16.833416 25758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:16.838734 25758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:16.839071 25758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:16.848760 25758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:16.850541 25758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:16.850688 25758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:16.850839 25758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:16.850944 25758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:16.917922 25758 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39711
I20260807 19:58:16.918011 25987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39711 every 8 connection(s)
I20260807 19:58:16.919849 25758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:58:16.925901 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 25758
I20260807 19:58:16.954427 25991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:16.927550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41318 (local address 127.5.197.190:37441)
0807 19:58:16.932871 (+ 5321us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:16.932878 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:16.932898 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:58:16.932964 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:16.932969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:16.933064 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:16.933172 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:16.935546 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.936765 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.941929 (+ 5164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.942574 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.942686 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:16.946275 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:16.946282 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:16.946287 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:16.946349 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:16.950085 (+ 3736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:16.951011 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:16.951017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:16.951020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:16.951190 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:16.951660 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:16.951687 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:16.951689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:16.952342 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:16.952590 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:16.953806 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0807 19:58:16.954040 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5177,"thread_start_us":5303,"threads_started":1}
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:16.966190 25992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:16.929361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37441 (local address 127.5.197.131:46633)
0807 19:58:16.937427 (+ 8066us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:16.937483 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:16.939759 (+ 2276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:16.944838 (+ 5079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:16.944851 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:16.945495 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:16.946090 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:16.946110 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.948382 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.948388 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:16.950286 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:16.950302 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.951356 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.951365 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:16.951641 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:16.952327 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:16.952367 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:16.956154 (+ 3787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:16.961699 (+ 5545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:16.961708 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:16.961724 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:16.962300 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:16.962746 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:16.962750 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:16.962753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:16.962980 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:16.963596 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:16.963604 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:16.964040 (+ 436us) client_negotiation.cc:769] Sending connection context
0807 19:58:16.964318 (+ 278us) client_negotiation.cc:240] Negotiation successful
0807 19:58:16.964849 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7765,"thread_start_us":7542,"threads_started":1}
I20260807 19:58:16.967636 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:16.933049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:46633 (local address 127.5.197.190:37441)
0807 19:58:16.944027 (+ 10978us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:16.944032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:16.944052 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:58:16.944099 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:16.944104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:16.944192 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:16.944317 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:16.946330 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.948161 (+ 1831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.950478 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:16.951080 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:16.952059 (+ 979us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:16.956485 (+ 4426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:16.956492 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:16.956497 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:16.956530 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:16.961531 (+ 5001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:16.962466 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:16.962471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:16.962474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:16.962614 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:16.963122 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:16.963126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:16.963129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:16.963450 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:16.966949 (+ 3499us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:16.967081 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 19:58:16.967282 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10854,"thread_start_us":11333,"threads_started":1}
I20260807 19:58:16.969071 25988 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37441
I20260807 19:58:16.969421 25988 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:16.970202 25988 heartbeater.cc:511] Master 127.5.197.190:37441 requested a full tablet report, sending...
I20260807 19:58:16.971812 25182 ts_manager.cc:194] Registered new tserver with Master: e6dfbcb63565412f8d9e31a77a7a09be (127.5.197.131:39711)
I20260807 19:58:16.972899 25182 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:46633
Aug 07 19:58:16 dist-test-slave-6bbx krb5kdc[23493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132696, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for HTTP/127.5.197.148@KRBTEST.COM
I20260807 19:58:16.991884 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:58:17.073112 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.027051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41328 (local address 127.5.197.190:37441)
0807 19:58:17.028090 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.028098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.056389 (+ 28291us) server_negotiation.cc:407] Connection header received
0807 19:58:17.056730 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.056737 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.056857 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.056937 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:17.059319 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.060502 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.062282 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.062942 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.063045 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.066696 (+ 3651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:17.066703 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:17.066709 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:17.066752 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:17.069914 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.070829 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.070835 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.070839 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.070992 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.071446 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.071451 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.071454 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.071799 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:17.071957 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.072573 (+ 616us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.072805 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":870}
I20260807 19:58:17.081795 25182 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41328:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:58:17.093304 25182 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:58:17.163013 26016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.123613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:35205 (local address 127.0.0.1:46500)
0807 19:58:17.147482 (+ 23869us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:17.147501 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:17.147627 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:17.150085 (+ 2458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:17.150095 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:17.150128 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:17.150583 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.150598 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.155352 (+ 4754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.155357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.159553 (+ 4196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.159570 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.161748 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.161754 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.161940 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.161991 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 19:58:17.162135 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 19:58:17.162347 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23748,"mutex_wait_us":35,"thread_start_us":23622,"threads_started":1}
I20260807 19:58:17.164222 26018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.124280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46500 (local address 127.5.197.129:35205)
0807 19:58:17.146053 (+ 21773us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.146064 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.149178 (+ 3114us) server_negotiation.cc:407] Connection header received
0807 19:58:17.149388 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.149396 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.149627 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.149806 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:17.151393 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.153149 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.159758 (+ 6609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.161214 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.161335 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.161575 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.163437 (+ 1862us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.163716 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21584,"thread_start_us":21412,"threads_started":1}
I20260807 19:58:17.164916 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.122493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43174 (local address 127.5.197.130:41407)
0807 19:58:17.148235 (+ 25742us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.148248 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.148283 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:58:17.148396 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.148405 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.148685 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.148891 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:17.153352 (+ 4461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.154978 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.160147 (+ 5169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.161943 (+ 1796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.162051 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.162254 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.164263 (+ 2009us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.164484 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25472,"thread_start_us":27450,"threads_started":1}
I20260807 19:58:17.164112 26020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.122212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41407 (local address 127.0.0.1:43174)
0807 19:58:17.146664 (+ 24452us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:17.146704 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:17.146911 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:17.150768 (+ 3857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:17.150773 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:17.150798 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:17.151168 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.151178 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.155177 (+ 3999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.155183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.159966 (+ 4783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.159981 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.163297 (+ 3316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.163302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.163463 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.163493 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 19:58:17.163575 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 19:58:17.163733 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24169,"mutex_wait_us":34,"thread_start_us":34953,"threads_started":1}
I20260807 19:58:17.169157 25403 tablet_service.cc:1467] Processing CreateTablet for tablet ef95641409764045bc083ce89a9fb318 (DEFAULT_TABLE table=test-table [id=54f3c88a6ede43dfbd3ac987d9c4d92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:17.170787 25403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef95641409764045bc083ce89a9fb318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:17.170472 25645 tablet_service.cc:1467] Processing CreateTablet for tablet ef95641409764045bc083ce89a9fb318 (DEFAULT_TABLE table=test-table [id=54f3c88a6ede43dfbd3ac987d9c4d92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:17.172043 25645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef95641409764045bc083ce89a9fb318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:17.178421 26014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.137643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39711 (local address 127.0.0.1:46782)
0807 19:58:17.157411 (+ 19768us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:17.157428 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:17.157537 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:17.168769 (+ 11232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:17.168774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:17.168803 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:17.169131 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.169144 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.172699 (+ 3555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.172704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.175027 (+ 2323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.175044 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.177668 (+ 2624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.177674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.177844 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.177879 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:58:17.177949 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 19:58:17.178081 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19643,"thread_start_us":8604,"threads_started":1}
I20260807 19:58:17.179746 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.137858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46782 (local address 127.5.197.131:39711)
0807 19:58:17.168124 (+ 30266us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.168132 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.168167 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:58:17.168267 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.168275 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.168522 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.169349 (+ 827us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:17.169692 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.172519 (+ 2827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.175990 (+ 3471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.177410 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.178812 (+ 1402us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.179111 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.179191 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.179364 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30075,"threads_started":1}
I20260807 19:58:17.184891 25869 tablet_service.cc:1467] Processing CreateTablet for tablet ef95641409764045bc083ce89a9fb318 (DEFAULT_TABLE table=test-table [id=54f3c88a6ede43dfbd3ac987d9c4d92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:17.186403 25869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef95641409764045bc083ce89a9fb318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:17.199018 26023 tablet_bootstrap.cc:492] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Bootstrap starting.
I20260807 19:58:17.200119 26022 tablet_bootstrap.cc:492] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Bootstrap starting.
I20260807 19:58:17.204013 26022 tablet_bootstrap.cc:654] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:17.204523 26023 tablet_bootstrap.cc:654] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:17.205410 26022 log.cc:824] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:17.205770 26023 log.cc:824] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:17.209862 26025 tablet_bootstrap.cc:492] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Bootstrap starting.
I20260807 19:58:17.213335 26023 tablet_bootstrap.cc:492] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: No bootstrap required, opened a new log
I20260807 19:58:17.213683 26023 ts_tablet_manager.cc:1397] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260807 19:58:17.214706 26025 tablet_bootstrap.cc:654] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:17.224305 26022 tablet_bootstrap.cc:492] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: No bootstrap required, opened a new log
I20260807 19:58:17.224658 26022 ts_tablet_manager.cc:1397] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.016s
I20260807 19:58:17.226223 26023 raft_consensus.cc:348] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.226703 26023 raft_consensus.cc:374] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:17.226835 26023 raft_consensus.cc:729] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fe83e96a744291a937e4b047e17f16, State: Initialized, Role: FOLLOWER
I20260807 19:58:17.226979 26025 log.cc:824] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:17.227564 26023 consensus_queue.cc:260] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.237373 26022 raft_consensus.cc:348] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.237941 26022 raft_consensus.cc:374] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:17.238088 26022 raft_consensus.cc:729] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aa336d186b3477d84c6d59966f7c6df, State: Initialized, Role: FOLLOWER
I20260807 19:58:17.238811 26022 consensus_queue.cc:260] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.239611 26025 tablet_bootstrap.cc:492] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: No bootstrap required, opened a new log
I20260807 19:58:17.240000 26025 ts_tablet_manager.cc:1397] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.008s
I20260807 19:58:17.245213 25502 heartbeater.cc:503] Master 127.5.197.190:37441 was elected leader, sending a full tablet report...
I20260807 19:58:17.245995 26023 ts_tablet_manager.cc:1428] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Time spent starting tablet: real 0.032s user 0.017s sys 0.012s
I20260807 19:58:17.246898 25754 heartbeater.cc:503] Master 127.5.197.190:37441 was elected leader, sending a full tablet report...
I20260807 19:58:17.247483 26022 ts_tablet_manager.cc:1428] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Time spent starting tablet: real 0.023s user 0.015s sys 0.005s
I20260807 19:58:17.253219 26025 raft_consensus.cc:348] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.253749 26025 raft_consensus.cc:374] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:17.253866 26025 raft_consensus.cc:729] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dfbcb63565412f8d9e31a77a7a09be, State: Initialized, Role: FOLLOWER
I20260807 19:58:17.254558 26025 consensus_queue.cc:260] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.255823 25988 heartbeater.cc:503] Master 127.5.197.190:37441 was elected leader, sending a full tablet report...
I20260807 19:58:17.256871 26025 ts_tablet_manager.cc:1428] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Time spent starting tablet: real 0.017s user 0.008s sys 0.003s
I20260807 19:58:17.272754 26035 raft_consensus.cc:482] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:58:17.273031 26035 raft_consensus.cc:504] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.275110 26035 leader_election.cc:288] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2aa336d186b3477d84c6d59966f7c6df (127.5.197.130:41407), e2fe83e96a744291a937e4b047e17f16 (127.5.197.129:35205)
I20260807 19:58:17.282564 25992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.275518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41407 (local address 127.5.197.131:58239)
0807 19:58:17.275868 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:17.275887 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:17.276009 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:17.276569 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:17.276575 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:17.276610 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:17.276830 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.276843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.278027 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.278031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.279839 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.279852 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.281694 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.281700 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.282036 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.282070 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:58:17.282170 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 19:58:17.282307 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233}
I20260807 19:58:17.282891 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.275741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:58239 (local address 127.5.197.130:41407)
0807 19:58:17.275936 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.275941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.275962 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:58:17.276200 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.276206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.276290 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.276374 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:17.276977 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.277886 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.279999 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.281397 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.281535 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.281604 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.282501 (+ 897us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.282642 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:58:17.284065 26018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.275833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:44303 (local address 127.5.197.129:35205)
0807 19:58:17.276051 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.276058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.277134 (+ 1076us) server_negotiation.cc:407] Connection header received
0807 19:58:17.277308 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.277313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.277388 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.277476 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:17.278144 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.279181 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.281670 (+ 2489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.282922 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.283059 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.283130 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.283710 (+ 580us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.283841 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:58:17.284192 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.275534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:35205 (local address 127.5.197.131:44303)
0807 19:58:17.277012 (+ 1478us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:17.277032 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:17.277177 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:17.277523 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:17.277528 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:17.277557 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:17.277939 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.277953 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.279356 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.279362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.281465 (+ 2103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:17.281480 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.283317 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.283323 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:17.283492 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.283524 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:58:17.283622 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 19:58:17.283779 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1350,"mutex_wait_us":452,"thread_start_us":659,"threads_started":1}
I20260807 19:58:17.284030 25676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef95641409764045bc083ce89a9fb318" candidate_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aa336d186b3477d84c6d59966f7c6df" is_pre_election: true
I20260807 19:58:17.284636 25676 raft_consensus.cc:2454] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6dfbcb63565412f8d9e31a77a7a09be in term 0.
I20260807 19:58:17.285354 25784 leader_election.cc:302] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aa336d186b3477d84c6d59966f7c6df, e6dfbcb63565412f8d9e31a77a7a09be; no voters:
I20260807 19:58:17.285349 25434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef95641409764045bc083ce89a9fb318" candidate_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fe83e96a744291a937e4b047e17f16" is_pre_election: true
I20260807 19:58:17.285722 26035 raft_consensus.cc:2781] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:58:17.285827 26035 raft_consensus.cc:482] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:58:17.285887 26035 raft_consensus.cc:3037] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:17.285921 25434 raft_consensus.cc:2454] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6dfbcb63565412f8d9e31a77a7a09be in term 0.
I20260807 19:58:17.288136 26035 raft_consensus.cc:504] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.288704 26035 leader_election.cc:288] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [CANDIDATE]: Term 1 election: Requested vote from peers 2aa336d186b3477d84c6d59966f7c6df (127.5.197.130:41407), e2fe83e96a744291a937e4b047e17f16 (127.5.197.129:35205)
I20260807 19:58:17.289083 25676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef95641409764045bc083ce89a9fb318" candidate_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aa336d186b3477d84c6d59966f7c6df"
I20260807 19:58:17.289234 25434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef95641409764045bc083ce89a9fb318" candidate_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2fe83e96a744291a937e4b047e17f16"
I20260807 19:58:17.289294 25676 raft_consensus.cc:3037] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:17.289427 25434 raft_consensus.cc:3037] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:17.292411 25676 raft_consensus.cc:2454] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6dfbcb63565412f8d9e31a77a7a09be in term 1.
I20260807 19:58:17.292554 25434 raft_consensus.cc:2454] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6dfbcb63565412f8d9e31a77a7a09be in term 1.
I20260807 19:58:17.292964 25784 leader_election.cc:302] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aa336d186b3477d84c6d59966f7c6df, e6dfbcb63565412f8d9e31a77a7a09be; no voters:
I20260807 19:58:17.293289 26035 raft_consensus.cc:2781] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:17.293795 26035 raft_consensus.cc:686] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 1 LEADER]: Becoming Leader. State: Replica: e6dfbcb63565412f8d9e31a77a7a09be, State: Running, Role: LEADER
I20260807 19:58:17.294350 26035 consensus_queue.cc:237] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } }
I20260807 19:58:17.299738 25179 catalog_manager.cc:5495] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be reported cstate change: term changed from 0 to 1, leader changed from <none> to e6dfbcb63565412f8d9e31a77a7a09be (127.5.197.131). New cstate: current_term: 1 leader_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6dfbcb63565412f8d9e31a77a7a09be" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39711 } health_report { overall_health: HEALTHY } } }
I20260807 19:58:17.325415 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.319802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46788 (local address 127.5.197.131:39711)
0807 19:58:17.319994 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.320001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.320098 (+ 97us) server_negotiation.cc:407] Connection header received
0807 19:58:17.320337 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.320341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.320418 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.320544 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:58:17.320937 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.321759 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.323303 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.323760 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.323869 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.324344 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:58:17.324851 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:58:17.324983 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.325090 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.325170 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 19:58:17.333475 25676 raft_consensus.cc:1261] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 1 FOLLOWER]: Refusing update from remote peer e6dfbcb63565412f8d9e31a77a7a09be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:17.333485 25434 raft_consensus.cc:1261] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 1 FOLLOWER]: Refusing update from remote peer e6dfbcb63565412f8d9e31a77a7a09be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:17.334502 26046 consensus_queue.cc:1035] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2fe83e96a744291a937e4b047e17f16" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 35205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:17.334823 26035 consensus_queue.cc:1035] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aa336d186b3477d84c6d59966f7c6df" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:17.349788 26052 mvcc.cc:205] Tried to move back new op lower bound from 7315999528267157504 to 7315999528122667008. Current Snapshot: MvccSnapshot[applied={T|T < 7315999528267157504}]
I20260807 19:58:17.354687 26056 mvcc.cc:205] Tried to move back new op lower bound from 7315999528267157504 to 7315999528122667008. Current Snapshot: MvccSnapshot[applied={T|T < 7315999528267157504}]
I20260807 19:58:17.371964 25179 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:17.372269 25179 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:17.376485 25179 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 325d6552b8534d4288b54e26fffdf5df: Sending DeleteTablet for 3 replicas of tablet ef95641409764045bc083ce89a9fb318
I20260807 19:58:17.377653 25645 tablet_service.cc:1514] Processing DeleteTablet for tablet ef95641409764045bc083ce89a9fb318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:17 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:43174
I20260807 19:58:17.377696 25403 tablet_service.cc:1514] Processing DeleteTablet for tablet ef95641409764045bc083ce89a9fb318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:17 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:46500
I20260807 19:58:17.380349 25869 tablet_service.cc:1514] Processing DeleteTablet for tablet ef95641409764045bc083ce89a9fb318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:17 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:46782
I20260807 19:58:17.392504 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 25239
I20260807 19:58:17.396234 26072 tablet_replica.cc:330] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: stopping tablet replica
I20260807 19:58:17.396701 26070 tablet_replica.cc:330] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: stopping tablet replica
I20260807 19:58:17.396791 26072 raft_consensus.cc:2229] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:58:17.397330 26070 raft_consensus.cc:2229] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:17.397591 26072 raft_consensus.cc:2258] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:17.398012 26070 raft_consensus.cc:2258] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:17.398860 26068 tablet_replica.cc:330] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: stopping tablet replica
I20260807 19:58:17.400087 26072 ts_tablet_manager.cc:1905] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:17.400621 26070 ts_tablet_manager.cc:1905] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:17.406410 26068 raft_consensus.cc:2229] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:17.406949 26068 raft_consensus.cc:2258] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:17.407069 26072 ts_tablet_manager.cc:1918] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:17.407358 26072 log.cc:1196] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/ef95641409764045bc083ce89a9fb318
I20260807 19:58:17.409035 26070 ts_tablet_manager.cc:1918] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:17.409291 26070 log.cc:1196] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/ef95641409764045bc083ce89a9fb318
I20260807 19:58:17.409386 26068 ts_tablet_manager.cc:1905] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:17.409960 26070 ts_tablet_manager.cc:1939] T ef95641409764045bc083ce89a9fb318 P e2fe83e96a744291a937e4b047e17f16: Deleting consensus metadata
I20260807 19:58:17.411926 25160 catalog_manager.cc:4841] TS e2fe83e96a744291a937e4b047e17f16 (127.5.197.129:35205): tablet ef95641409764045bc083ce89a9fb318 (table test-table [id=54f3c88a6ede43dfbd3ac987d9c4d92a]) successfully deleted
I20260807 19:58:17.412770 26072 ts_tablet_manager.cc:1939] T ef95641409764045bc083ce89a9fb318 P e6dfbcb63565412f8d9e31a77a7a09be: Deleting consensus metadata
I20260807 19:58:17.416488 26018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.393523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46506 (local address 127.5.197.129:35205)
0807 19:58:17.393718 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.393725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.395306 (+ 1581us) server_negotiation.cc:407] Connection header received
0807 19:58:17.395379 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.395384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.395463 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.395555 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:17.400710 (+ 5155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.401891 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.404008 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.404706 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.404841 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.408436 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:17.408450 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:17.408468 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:17.408507 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:17.412549 (+ 4042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.413464 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.413472 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.413476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.413635 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.414110 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.414115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.414118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.414582 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:17.414881 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.415884 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.416107 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:58:17.416838 26068 ts_tablet_manager.cc:1918] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:17.417807 25496 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:17.418948 25155 catalog_manager.cc:4841] TS e6dfbcb63565412f8d9e31a77a7a09be (127.5.197.131:39711): tablet ef95641409764045bc083ce89a9fb318 (table test-table [id=54f3c88a6ede43dfbd3ac987d9c4d92a]) successfully deleted
I20260807 19:58:17.419488 26068 log.cc:1196] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/ef95641409764045bc083ce89a9fb318
I20260807 19:58:17.420110 26068 ts_tablet_manager.cc:1939] T ef95641409764045bc083ce89a9fb318 P 2aa336d186b3477d84c6d59966f7c6df: Deleting consensus metadata
I20260807 19:58:17.421978 25157 catalog_manager.cc:4841] TS 2aa336d186b3477d84c6d59966f7c6df (127.5.197.130:41407): tablet ef95641409764045bc083ce89a9fb318 (table test-table [id=54f3c88a6ede43dfbd3ac987d9c4d92a]) successfully deleted
I20260807 19:58:17.574982 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 25239
I20260807 19:58:17.608165 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 25507
I20260807 19:58:17.624709 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.609343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43180 (local address 127.5.197.130:41407)
0807 19:58:17.609533 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.609539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.609560 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:58:17.609630 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.609635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.609732 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.609855 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:17.611731 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.612986 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.614353 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.615004 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.615130 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.617863 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:17.617884 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:17.617904 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:17.617948 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:17.621708 (+ 3760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.622465 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.622475 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.622479 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.622669 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.623080 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.623085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.623089 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.623472 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:17.623794 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.624094 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.624350 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:58:17.625416 25743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:17.715224 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 25507
I20260807 19:58:17.748087 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 25758
I20260807 19:58:17.763767 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:17.748847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52842 (local address 127.5.197.131:39711)
0807 19:58:17.749052 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:17.749058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:17.749081 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:58:17.749214 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:17.749220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:17.749318 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:17.749427 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:17.750909 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.752180 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.753470 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:17.754128 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:17.754287 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:17.756701 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:17.756716 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:17.756737 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:17.756783 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:17.760810 (+ 4027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.761467 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.761476 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.761480 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.761687 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:17.762036 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:17.762041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:17.762049 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:17.762557 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:17.762885 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:17.763068 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 19:58:17.763316 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 19:58:17.764503 25976 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:17.895596 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 25758
I20260807 19:58:17.923746 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 25128
I20260807 19:58:17.925004 25229 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:18.037811 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 25128
I20260807 19:58:18.065186 5910 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 19:58:18.409549 5910 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 19:58:18.409770 5910 mini_ranger.cc:66] Stopping Ranger...
I20260807 19:58:18.753682 5910 mini_ranger.cc:68] Stopped Ranger
2026-08-07 19:58:18.753 UTC [23539] LOG: received smart shutdown request
2026-08-07 19:58:18.756 UTC [23539] LOG: background worker "logical replication launcher" (PID 23551) exited with exit code 1
2026-08-07 19:58:18.757 UTC [23545] LOG: shutting down
2026-08-07 19:58:18.902 UTC [23539] LOG: database system is shut down
2026-08-07T19:58:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52579 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:58:19 dist-test-slave-6bbx krb5kdc[26088](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:58:19 dist-test-slave-6bbx krb5kdc[26088](info): set up 2 sockets
Aug 07 19:58:19 dist-test-slave-6bbx krb5kdc[26088](info): commencing operation
krb5kdc: starting...
W20260807 19:58:20.213263 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.006s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:58:20 dist-test-slave-6bbx krb5kdc[26088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:58:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:58:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:58:20.472577 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34671
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:34671,127.5.197.189:40437,127.5.197.188:34855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:20.800824 26111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:20.801098 26111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:20.801196 26111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:20.808189 26111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:20.808284 26111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:20.808328 26111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:20.808389 26111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:20.808434 26111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:20.817766 26111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:34671,127.5.197.189:40437,127.5.197.188:34855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:20.819018 26111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:20.820263 26111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:20.831772 26121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:20.831838 26119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:20.831804 26118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:20.832926 26111 server_base.cc:1034] running on GCE node
I20260807 19:58:20.833632 26111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:20.834995 26111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:20.836210 26111 hybrid_clock.cc:648] HybridClock initialized: now 1786132700836152 us; error 34 us; skew 500 ppm
I20260807 19:58:20.836550 26111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:20 dist-test-slave-6bbx krb5kdc[26088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:20.839509 26111 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:20.840934 26111 webserver.cc:460] Webserver started at http://127.5.197.190:33981/ using document root <none> and password file <none>
I20260807 19:58:20.841579 26111 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:20.841677 26111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:20.841921 26111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:20.844852 26111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "8f1a66de062f49f6919297a22c47d9a0"
format_stamp: "Formatted at 2026-08-07 19:58:20 on dist-test-slave-6bbx"
server_key: "9fee0a886c1c57cc000eac2ff79b1e03"
server_key_iv: "9eded1615fc6e4af6fe1b8c8523874fd"
server_key_version: "encryptionkey@0"
I20260807 19:58:20.845578 26111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "8f1a66de062f49f6919297a22c47d9a0"
format_stamp: "Formatted at 2026-08-07 19:58:20 on dist-test-slave-6bbx"
server_key: "9fee0a886c1c57cc000eac2ff79b1e03"
server_key_iv: "9eded1615fc6e4af6fe1b8c8523874fd"
server_key_version: "encryptionkey@0"
I20260807 19:58:20.850383 26111 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 19:58:20.853586 26129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:20.854833 26111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:58:20.854969 26111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "8f1a66de062f49f6919297a22c47d9a0"
format_stamp: "Formatted at 2026-08-07 19:58:20 on dist-test-slave-6bbx"
server_key: "9fee0a886c1c57cc000eac2ff79b1e03"
server_key_iv: "9eded1615fc6e4af6fe1b8c8523874fd"
server_key_version: "encryptionkey@0"
I20260807 19:58:20.855129 26111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:20.881955 26111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:20.885947 26111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:20.886179 26111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:20.903322 26111 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:34671
I20260807 19:58:20.903376 26213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:34671 every 8 connection(s)
I20260807 19:58:20.904842 26111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:20.905745 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 26111
I20260807 19:58:20.905992 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:58:20.906630 5910 external_mini_cluster.cc:1428] Setting key b5c420a246367de62a248605ddb13429
I20260807 19:58:20.908746 26215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:20.916445 26215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:58:20 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.197.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.189@KRBTEST.COM" created.
I20260807 19:58:20.937566 26219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:20.919772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58988 (local address 127.5.197.190:34671)
0807 19:58:20.920586 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:20.920604 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:20.921002 (+ 398us) server_negotiation.cc:407] Connection header received
0807 19:58:20.922895 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:20.922900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:20.923106 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:20.923274 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:20.924542 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:20.925743 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:20.927145 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:20.927715 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:20.927871 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:20.931171 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:20.931178 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:20.931190 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:20.931217 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:20.933841 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:20.934516 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:20.934523 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:20.934525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:20.934659 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:20.935030 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:20.935035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:20.935037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:20.935511 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:20.935717 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:20.936311 (+ 594us) server_negotiation.cc:299] Negotiation successful
0807 19:58:20.936561 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":358,"threads_started":1}
I20260807 19:58:20.937608 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:20.919773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34671 (local address 127.0.0.1:58988)
0807 19:58:20.920850 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:20.920883 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:20.922562 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:20.923326 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:20.923333 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:20.924031 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:20.924356 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:20.924373 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:20.925888 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:20.925892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:20.927014 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:20.927027 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:20.927949 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:20.927956 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:20.928117 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:20.928721 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:20.928743 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:20.930970 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:20.933963 (+ 2993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:20.933974 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:20.933985 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:20.934396 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:20.934762 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:20.934767 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:20.934771 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:20.934932 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:20.935643 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:20.935650 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:20.935921 (+ 271us) client_negotiation.cc:769] Sending connection context
0807 19:58:20.936157 (+ 236us) client_negotiation.cc:240] Negotiation successful
0807 19:58:20.936741 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":879,"mutex_wait_us":121,"spinlock_wait_cycles":16768,"thread_start_us":671,"threads_started":1}
I20260807 19:58:20.940404 26215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:58:20.941367 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:20.940961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59902)
0807 19:58:20.941115 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:20.941238 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 19:58:20.941597 26135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
I20260807 19:58:20.943038 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:20.942694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59916)
0807 19:58:20.942830 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:20.942904 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 19:58:20.943215 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:40437: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab.
Entry for principal kudu/127.5.197.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab.
I20260807 19:58:20.967303 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:40437
--webserver_interface=127.5.197.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab
--principal=kudu/127.5.197.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:34671,127.5.197.189:40437,127.5.197.188:34855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:58:20.992537 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } attempt: 1
I20260807 19:58:20.993799 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:20.993256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59918)
0807 19:58:20.993475 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:20.993624 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 19:58:20.994784 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:20.994402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59924)
0807 19:58:20.994535 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:20.994616 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 19:58:20.994966 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:40437: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
I20260807 19:58:21.066790 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } attempt: 2
I20260807 19:58:21.068203 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.067532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59926)
0807 19:58:21.067913 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.068023 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
I20260807 19:58:21.069392 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.068934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59934)
0807 19:58:21.069146 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.069227 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260807 19:58:21.069626 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:40437: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
I20260807 19:58:21.160882 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } attempt: 3
I20260807 19:58:21.162187 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.161618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59936)
0807 19:58:21.161864 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.161993 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 19:58:21.163276 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.162847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59950)
0807 19:58:21.162994 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.163103 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 19:58:21.163477 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:40437: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
W20260807 19:58:21.297514 26224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:21.297778 26224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:21.297875 26224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:21.304802 26224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:21.304899 26224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:21.304953 26224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:21.305008 26224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:21.305050 26224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:21.306742 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } attempt: 4
I20260807 19:58:21.308070 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.307394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59964)
0807 19:58:21.307778 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.307897 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260807 19:58:21.309073 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.308680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59976)
0807 19:58:21.308824 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.308923 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 19:58:21.309266 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:40437: Network error: Client connection negotiation failed: client connection to 127.5.197.189:40437: connect: Connection refused (error 111)
I20260807 19:58:21.315095 26224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:34671,127.5.197.189:40437,127.5.197.188:34855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab
--principal=kudu/127.5.197.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:40437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.197.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:21.316344 26224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:21.317535 26224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:21.328752 26230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:21.328824 26232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:21.328780 26236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:21.333081 26224 server_base.cc:1034] running on GCE node
I20260807 19:58:21.333953 26224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:21.335229 26224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:21.336465 26224 hybrid_clock.cc:648] HybridClock initialized: now 1786132701336419 us; error 36 us; skew 500 ppm
I20260807 19:58:21.336793 26224 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:21.339898 26224 init.cc:377] Logged in from keytab as kudu/127.5.197.189@KRBTEST.COM (short username kudu)
I20260807 19:58:21.341291 26224 webserver.cc:460] Webserver started at http://127.5.197.189:38223/ using document root <none> and password file <none>
I20260807 19:58:21.341952 26224 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:21.342070 26224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:21.342387 26224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:21.345283 26224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data/instance:
uuid: "3c7e1945c88c4212868b87f8bdb7b065"
format_stamp: "Formatted at 2026-08-07 19:58:21 on dist-test-slave-6bbx"
server_key: "afbde98b4ad87a9796a41cb6a6e0b2f1"
server_key_iv: "6b75f975cacf8bc6651e51ae7b1f22bb"
server_key_version: "encryptionkey@0"
I20260807 19:58:21.346045 26224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/wal/instance:
uuid: "3c7e1945c88c4212868b87f8bdb7b065"
format_stamp: "Formatted at 2026-08-07 19:58:21 on dist-test-slave-6bbx"
server_key: "afbde98b4ad87a9796a41cb6a6e0b2f1"
server_key_iv: "6b75f975cacf8bc6651e51ae7b1f22bb"
server_key_version: "encryptionkey@0"
I20260807 19:58:21.350847 26224 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 19:58:21.354122 26247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:21.355373 26224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:58:21.355526 26224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/wal
uuid: "3c7e1945c88c4212868b87f8bdb7b065"
format_stamp: "Formatted at 2026-08-07 19:58:21 on dist-test-slave-6bbx"
server_key: "afbde98b4ad87a9796a41cb6a6e0b2f1"
server_key_iv: "6b75f975cacf8bc6651e51ae7b1f22bb"
server_key_version: "encryptionkey@0"
I20260807 19:58:21.355724 26224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:21.369844 26224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:21.373556 26224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:21.373812 26224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:21.391147 26224 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.189:40437
I20260807 19:58:21.391181 26323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.189:40437 every 8 connection(s)
I20260807 19:58:21.392504 26224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
I20260807 19:58:21.394454 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 26224
I20260807 19:58:21.394665 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-1/wal/instance
I20260807 19:58:21.395226 5910 external_mini_cluster.cc:1428] Setting key 8597c3a160f250bdbc8e369c8cca98db
I20260807 19:58:21.396729 26324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:21.405089 26324 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.197.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.188@KRBTEST.COM" created.
I20260807 19:58:21.426213 26219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.407994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59002 (local address 127.5.197.190:34671)
0807 19:58:21.408153 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.408158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.409735 (+ 1577us) server_negotiation.cc:407] Connection header received
0807 19:58:21.411547 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.411553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.411636 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.411751 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.413604 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.414260 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.416404 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.416815 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.416908 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.420572 (+ 3664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.420576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.420580 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.420612 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.423130 (+ 2518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.423832 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.423837 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.423840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.423960 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.424373 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.424377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.424379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.424735 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.424871 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.425546 (+ 675us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.425848 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 19:58:21.427150 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.408607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34671 (local address 127.0.0.1:59002)
0807 19:58:21.409572 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.409617 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:21.411284 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:21.412034 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:21.412047 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:21.412735 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:21.413446 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.413469 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.414417 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.414421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.416261 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.416275 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.417032 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.417038 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.417287 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.417928 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:21.417954 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:21.420357 (+ 2403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:21.423268 (+ 2911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.423277 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.423291 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.423723 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.424064 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.424069 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.424073 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.424252 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.424873 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:21.424881 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:21.425177 (+ 296us) client_negotiation.cc:769] Sending connection context
0807 19:58:21.425397 (+ 220us) client_negotiation.cc:240] Negotiation successful
0807 19:58:21.425848 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":427,"threads_started":1}
I20260807 19:58:21.428732 26324 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 19:58:21.442219 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.429280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59978)
0807 19:58:21.429472 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.429487 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:21.429569 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:21.430564 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:21.430568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:21.430969 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:21.431092 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.431100 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.432468 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.432472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.433261 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.433272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.434026 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.434031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.434214 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.434703 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:21.434719 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:21.436647 (+ 1928us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:21.439770 (+ 3123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.439775 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.439780 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.440245 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.440604 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.440609 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.440612 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.440737 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.441292 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:21.441297 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:21.441459 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 19:58:21.441573 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 19:58:21.441820 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 19:58:21.442322 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.429589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59978 (local address 127.5.197.189:40437)
0807 19:58:21.430203 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.430208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.430231 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:58:21.430270 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.430275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.430428 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.430555 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.431235 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.432342 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.433387 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.433897 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.434003 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.436832 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.436843 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.436855 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.436885 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.439630 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.440373 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.440381 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.440385 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.440494 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.440831 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.440836 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.440840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.441172 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.441335 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.441719 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.441929 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":357,"threads_started":1}
I20260807 19:58:21.444716 26324 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:58:21.445746 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.445350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40244)
0807 19:58:21.445502 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.445599 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 19:58:21.445989 26249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.447603 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.447278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40250)
0807 19:58:21.447435 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.447508 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 19:58:21.447829 26324 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab.
Entry for principal kudu/127.5.197.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab.
I20260807 19:58:21.458143 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:34855
--webserver_interface=127.5.197.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab
--principal=kudu/127.5.197.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:34671,127.5.197.189:40437,127.5.197.188:34855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:58:21.497120 26324 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 1
I20260807 19:58:21.498404 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.497871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40266)
0807 19:58:21.498092 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.498246 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 19:58:21.499454 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.499045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40278)
0807 19:58:21.499248 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.499339 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260807 19:58:21.499696 26324 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.567904 26324 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 2
I20260807 19:58:21.569033 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.568590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40284)
0807 19:58:21.568775 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.568875 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 19:58:21.570034 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.569722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40290)
0807 19:58:21.569850 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.569922 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 19:58:21.570237 26324 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.608508 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } attempt: 5
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 19:58:21.621405 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.609331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59994 (local address 127.5.197.189:40437)
0807 19:58:21.609524 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.609530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.609553 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:58:21.609702 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.609707 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.609792 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.609898 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.610678 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.611380 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.612561 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.613001 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.613115 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.616353 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.616359 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.616364 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.616399 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.618855 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.619647 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.619651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.619653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.619800 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.620194 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.620197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.620199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.620464 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.620569 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.621017 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.621184 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:58:21.621594 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.609194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:59994)
0807 19:58:21.609410 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.609433 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:21.609566 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:21.609942 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:21.609947 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:21.610338 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:21.610522 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.610532 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.611514 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.611520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.612422 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.612436 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.613152 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.613158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.613327 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.613912 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:21.613930 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:21.616154 (+ 2224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:21.619011 (+ 2857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.619017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.619021 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.619536 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.619906 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.619911 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.619915 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.620097 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.620579 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:21.620584 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:21.620784 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 19:58:21.620950 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 19:58:21.621245 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 19:58:21.622705 26215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:58:21.623853 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.623462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40298)
0807 19:58:21.623619 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.623722 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 19:58:21.624771 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.624489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40308)
0807 19:58:21.624616 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.624679 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 19:58:21.624980 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.661430 26324 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 3
I20260807 19:58:21.662501 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.662010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40324)
0807 19:58:21.662237 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.662338 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 19:58:21.663488 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.663081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40328)
0807 19:58:21.663299 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.663375 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260807 19:58:21.663722 26324 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.676169 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 1
I20260807 19:58:21.677175 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.676740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40330)
0807 19:58:21.676952 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.677031 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260807 19:58:21.678083 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.677755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40332)
0807 19:58:21.677897 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.677982 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 19:58:21.678282 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.746483 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 2
I20260807 19:58:21.747637 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.747176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40342)
0807 19:58:21.747379 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.747469 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 19:58:21.748600 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.748287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40358)
0807 19:58:21.748434 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.748500 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 19:58:21.748803 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
W20260807 19:58:21.792570 26333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:21.792877 26333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:21.793015 26333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:21.800149 26333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:21.800257 26333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:21.800340 26333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:21.800420 26333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:21.800479 26333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:21.806931 26324 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 4
I20260807 19:58:21.808050 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.807537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40366)
0807 19:58:21.807801 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.807896 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 19:58:21.808980 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.808652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40374)
0807 19:58:21.808797 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.808873 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 19:58:21.809172 26324 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.810304 26333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:34671,127.5.197.189:40437,127.5.197.188:34855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab
--principal=kudu/127.5.197.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:34855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.197.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:21.811641 26333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:21.812971 26333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:21.824260 26343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:21.824438 26340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:21.824580 26341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:21.825548 26333 server_base.cc:1034] running on GCE node
I20260807 19:58:21.826257 26333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:21.827586 26333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:21.828847 26333 hybrid_clock.cc:648] HybridClock initialized: now 1786132701828801 us; error 51 us; skew 500 ppm
I20260807 19:58:21.829180 26333 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:21.832267 26333 init.cc:377] Logged in from keytab as kudu/127.5.197.188@KRBTEST.COM (short username kudu)
I20260807 19:58:21.833606 26333 webserver.cc:460] Webserver started at http://127.5.197.188:44653/ using document root <none> and password file <none>
I20260807 19:58:21.834246 26333 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:21.834344 26333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:21.834606 26333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:21.837582 26333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data/instance:
uuid: "f76dc91062c74245834adbc08c25ccbd"
format_stamp: "Formatted at 2026-08-07 19:58:21 on dist-test-slave-6bbx"
server_key: "fd2b3e9bcd0566ee29bc9cd5f3b5b409"
server_key_iv: "d1d5b749a1e693b031398c00f1588a42"
server_key_version: "encryptionkey@0"
I20260807 19:58:21.838327 26333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/wal/instance:
uuid: "f76dc91062c74245834adbc08c25ccbd"
format_stamp: "Formatted at 2026-08-07 19:58:21 on dist-test-slave-6bbx"
server_key: "fd2b3e9bcd0566ee29bc9cd5f3b5b409"
server_key_iv: "d1d5b749a1e693b031398c00f1588a42"
server_key_version: "encryptionkey@0"
I20260807 19:58:21.843381 26333 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:58:21.846660 26357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:21.847937 26333 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 19:58:21.848076 26333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/wal
uuid: "f76dc91062c74245834adbc08c25ccbd"
format_stamp: "Formatted at 2026-08-07 19:58:21 on dist-test-slave-6bbx"
server_key: "fd2b3e9bcd0566ee29bc9cd5f3b5b409"
server_key_iv: "d1d5b749a1e693b031398c00f1588a42"
server_key_version: "encryptionkey@0"
I20260807 19:58:21.848248 26333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:21.854991 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 3
I20260807 19:58:21.855988 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.855519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40386)
0807 19:58:21.855746 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.855829 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 19:58:21.856963 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.856604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40396)
0807 19:58:21.856787 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.856863 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260807 19:58:21.857169 26215 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:34855: Network error: Client connection negotiation failed: client connection to 127.5.197.188:34855: connect: Connection refused (error 111)
I20260807 19:58:21.870306 26333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:21.874224 26333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:21.874606 26333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:21.892715 26333 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.188:34855
I20260807 19:58:21.892738 26432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.188:34855 every 8 connection(s)
I20260807 19:58:21.894064 26333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
I20260807 19:58:21.897776 26434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:21.902282 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 26333
I20260807 19:58:21.902489 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132491354022-5910-0/minicluster-data/master-2/wal/instance
I20260807 19:58:21.903115 5910 external_mini_cluster.cc:1428] Setting key d70114b1e72f4cc40396b6ffd99f9e23
I20260807 19:58:21.905016 26434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
I20260807 19:58:21.932936 26219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.908836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59006 (local address 127.5.197.190:34671)
0807 19:58:21.909063 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.909070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.915849 (+ 6779us) server_negotiation.cc:407] Connection header received
0807 19:58:21.917252 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.917257 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.917330 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.917430 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.919068 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.920152 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.922221 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.922755 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.922885 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.926661 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.926666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.926669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.926701 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.929790 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.930493 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.930499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.930503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.930676 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.931078 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.931082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.931085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.931378 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.931493 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.932334 (+ 841us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.932569 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:58:21.933888 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.908347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34671 (local address 127.0.0.1:59006)
0807 19:58:21.915660 (+ 7313us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.915722 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:21.917004 (+ 1282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:21.917513 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:21.917520 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:21.918329 (+ 809us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:21.918891 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.918916 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.920309 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.920312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.922045 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.922060 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.922974 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.922980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.923230 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.924021 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:21.924059 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:21.926481 (+ 2422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:21.929920 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.929929 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.929938 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.930376 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.930796 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.930799 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.930802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.930978 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.931525 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:21.931533 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:21.931936 (+ 403us) client_negotiation.cc:769] Sending connection context
0807 19:58:21.932221 (+ 285us) client_negotiation.cc:240] Negotiation successful
0807 19:58:21.932610 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7052,"mutex_wait_us":45,"thread_start_us":6900,"threads_started":1}
I20260807 19:58:21.933947 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.905044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40412 (local address 127.5.197.188:34855)
0807 19:58:21.915203 (+ 10159us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.915214 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.915259 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:58:21.916997 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.917019 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.917281 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.917481 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.919309 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.920831 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.922589 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.923382 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.923488 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.928031 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.928041 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.928057 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.928100 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.931088 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.931793 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.931800 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.931802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.931929 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.932315 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.932320 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.932322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.932771 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.933068 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.933420 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.933590 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":9941,"thread_start_us":9719,"threads_started":1}
I20260807 19:58:21.935508 26434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:21.948417 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.936268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60000 (local address 127.5.197.189:40437)
0807 19:58:21.936464 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.936470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.936509 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:58:21.936570 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.936575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.936635 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.936717 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.937502 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.938177 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.939407 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.939864 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.939958 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.942949 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.942957 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.942962 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.943005 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.945948 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.946675 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.946678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.946681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.946813 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.947194 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.947198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.947200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.947459 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.947566 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.947982 (+ 416us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.948147 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:58:21.948503 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.936121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:40437 (local address 127.0.0.1:60000)
0807 19:58:21.936360 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.936377 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:21.936450 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:21.936763 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:21.936768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:21.937189 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:21.937372 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.937384 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.938314 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.938320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.939264 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.939276 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.940001 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.940007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.940218 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.940720 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:21.940741 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:21.942753 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:21.946073 (+ 3320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.946078 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.946082 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.946567 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.946918 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.946923 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.946926 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.947091 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.947577 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:21.947582 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:21.947764 (+ 182us) client_negotiation.cc:769] Sending connection context
0807 19:58:21.947911 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 19:58:21.948161 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260807 19:58:21.949321 26434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:58:21.951325 26219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.936947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59020 (local address 127.5.197.190:34671)
0807 19:58:21.937092 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.937096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.937110 (+ 14us) server_negotiation.cc:407] Connection header received
0807 19:58:21.937206 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.937209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.937264 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.937334 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.938546 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.939267 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.940713 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.941101 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.941187 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.945616 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.945621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.945624 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.945653 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.948513 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.949197 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.949201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.949204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.949364 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.949725 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.949730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.949733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.950084 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.950330 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.950757 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.950960 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
Aug 07 19:58:21 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 19:58:21.962596 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.949967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40418)
0807 19:58:21.950143 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:21.950160 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:21.950247 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:21.950513 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:21.950517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:21.950982 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:21.951170 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.951181 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.952450 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.952455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.953686 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:21.953702 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.954371 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.954376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:21.954552 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.955078 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:21.955094 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:21.957232 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:21.960251 (+ 3019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.960256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.960259 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.960668 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.961077 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:21.961082 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:21.961085 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:21.961209 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:21.961670 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:21.961674 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:21.961803 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 19:58:21.961934 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 19:58:21.962218 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 19:58:21.962663 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.950121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.5.197.188:34855)
0807 19:58:21.950297 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.950302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.950317 (+ 15us) server_negotiation.cc:407] Connection header received
0807 19:58:21.950354 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.950359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.950410 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.950482 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.951324 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.952304 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.953821 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.954231 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.954322 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.957410 (+ 3088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.957416 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.957421 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.957456 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.960101 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.960781 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.960786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.960790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.960972 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.961307 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.961312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.961316 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.961560 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.961681 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.962039 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.962386 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":128,"server-negotiator.queue_time_us":58}
I20260807 19:58:21.967010 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.952991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.5.197.189:40437)
0807 19:58:21.953125 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.953129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.953143 (+ 14us) server_negotiation.cc:407] Connection header received
0807 19:58:21.953257 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.953260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.953308 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.953385 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.954687 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.955474 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.956955 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.957396 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.957517 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.961769 (+ 4252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.961773 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.961776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.961806 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.964631 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.965224 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.965230 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.965234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.965357 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.965712 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.965717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.965721 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.965973 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.966224 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.966506 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.966719 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 19:58:21.967538 26434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd: Bootstrap starting.
I20260807 19:58:21.971117 26434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:21.971772 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:58:21.972289 26434 log.cc:824] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:21.974963 26434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd: No bootstrap required, opened a new log
I20260807 19:58:21.985766 26434 raft_consensus.cc:348] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:21.986374 26434 raft_consensus.cc:374] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:21.986562 26434 raft_consensus.cc:729] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76dc91062c74245834adbc08c25ccbd, State: Initialized, Role: FOLLOWER
I20260807 19:58:21.987403 26434 consensus_queue.cc:260] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:21.988659 26452 sys_catalog.cc:455] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:21.989178 26452 sys_catalog.cc:458] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:58:21.990633 26434 sys_catalog.cc:564] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:21.997467 26219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.976646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59024 (local address 127.5.197.190:34671)
0807 19:58:21.976825 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.976831 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.977383 (+ 552us) server_negotiation.cc:407] Connection header received
0807 19:58:21.977639 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.977645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.977740 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.977810 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.980433 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.981607 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.983977 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.984657 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.984762 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.989939 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.989945 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.989949 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.989990 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.994106 (+ 4116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.994985 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.994991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.994995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.995200 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:21.995702 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:21.995708 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:21.995711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:21.996073 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:21.996306 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:21.996916 (+ 610us) server_negotiation.cc:299] Negotiation successful
0807 19:58:21.997116 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:58:22.005194 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.977532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60018 (local address 127.5.197.189:40437)
0807 19:58:21.977686 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.977692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.988763 (+ 11071us) server_negotiation.cc:407] Connection header received
0807 19:58:21.988935 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.988940 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.989015 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.989100 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.992265 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.993294 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.995433 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.996091 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.996175 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.999136 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.999140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.999144 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.999177 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:22.001964 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.002825 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.002830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.002833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.002982 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.003447 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.003453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.003456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.003814 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:22.004078 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:22.004648 (+ 570us) server_negotiation.cc:299] Negotiation successful
0807 19:58:22.004859 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:58:22.006691 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:21.977108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40434 (local address 127.5.197.188:34855)
0807 19:58:21.977268 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:21.977273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:21.986050 (+ 8777us) server_negotiation.cc:407] Connection header received
0807 19:58:21.986187 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:21.986192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:21.986276 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:21.986376 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:21.989001 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.989802 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.991823 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:21.992348 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:21.992487 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:21.995888 (+ 3401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:21.995895 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:21.995901 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:21.995942 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:21.999879 (+ 3937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.002781 (+ 2902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.002787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.002791 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.003043 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.003575 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.003581 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.003585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.004063 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:22.005253 (+ 1190us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:22.005887 (+ 634us) server_negotiation.cc:299] Negotiation successful
0807 19:58:22.006125 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 19:58:22.014140 26467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:58:22.014282 26467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:58:22.010996 26333 master_runner.cc:186] Error getting master registration for 127.5.197.190:34671: OK, instance_id { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" instance_seqno: 1786132700898377 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:58:22.019811 26333 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 19:58:22.034366 26215 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 4
Aug 07 19:58:22 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132700, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
I20260807 19:58:22.048890 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:22.035019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40450 (local address 127.5.197.188:34855)
0807 19:58:22.035202 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:22.035207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:22.035257 (+ 50us) server_negotiation.cc:407] Connection header received
0807 19:58:22.035314 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:22.035319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:22.035416 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:22.035503 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:22.036370 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.037536 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.038717 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.039428 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.039558 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:22.042673 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:22.042680 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:22.042685 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:22.042722 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:22.046282 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.047071 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.047075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.047077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.047219 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.047635 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.047638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.047640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.047943 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:22.048054 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:22.048460 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 19:58:22.048633 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:58:22.049039 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:22.034914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40450)
0807 19:58:22.035091 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:22.035111 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:22.035212 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:22.035555 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:22.035560 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:22.036017 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:22.036205 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:22.036219 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.037660 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.037666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:22.038572 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:22.038584 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.039548 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.039551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:22.039704 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:22.040269 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:22.040286 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:22.042495 (+ 2209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:22.046440 (+ 3945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:22.046446 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:22.046449 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:22.046957 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:22.047347 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:22.047352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:22.047355 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:22.047536 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:22.048056 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:22.048061 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:22.048229 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 19:58:22.048384 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 19:58:22.048656 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 19:58:22.055001 26215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: Bootstrap starting.
I20260807 19:58:22.059087 26215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:22.060561 26215 log.cc:824] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:22.063634 26215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: No bootstrap required, opened a new log
I20260807 19:58:22.074239 26215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:22.074609 26215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:22.074733 26215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f1a66de062f49f6919297a22c47d9a0, State: Initialized, Role: FOLLOWER
I20260807 19:58:22.075364 26215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:22.076332 26471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.076630 26471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:58:22.077600 26215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 19:58:22.086663 26484 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:58:22.086880 26484 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:58:22.088450 26111 master_runner.cc:186] Error getting master registration for 127.5.197.189:40437: OK, instance_id { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" instance_seqno: 1786132701386128 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:58:22.099625 26111 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 19:58:22.108390 26324 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } attempt: 5
Aug 07 19:58:22 dist-test-slave-6bbx krb5kdc[26088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132701, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
I20260807 19:58:22.126530 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:22.108989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:34855 (local address 127.0.0.1:40452)
0807 19:58:22.109272 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:22.109293 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:22.109422 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:22.109781 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:22.109786 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:22.110343 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:22.110565 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:22.110578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.112082 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.112088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:22.113558 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:22.113576 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.114565 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.114572 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:22.114798 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:22.115487 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:22.115511 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:22.118442 (+ 2931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:22.123589 (+ 5147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:22.123596 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:22.123601 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:22.124178 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:22.124639 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:22.124644 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:22.124648 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:22.124828 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:22.125494 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:22.125499 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:22.125670 (+ 171us) client_negotiation.cc:769] Sending connection context
0807 19:58:22.125839 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 19:58:22.126146 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
W20260807 19:58:22.126827 26366 tablet.cc:2369] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:58:22.127786 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:22.109080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40452 (local address 127.5.197.188:34855)
0807 19:58:22.109264 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:22.109270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:22.109368 (+ 98us) server_negotiation.cc:407] Connection header received
0807 19:58:22.109542 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:22.109548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:22.109631 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:22.109736 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:22.110729 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.111928 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.113718 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:22.114410 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:22.114542 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:22.118664 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:22.118671 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:22.118676 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:22.118732 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:22.123440 (+ 4708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.124350 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.124357 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.124360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.124516 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:22.124962 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:22.124967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:22.124971 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:22.125364 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:22.125523 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:22.126075 (+ 552us) server_negotiation.cc:299] Negotiation successful
0807 19:58:22.126352 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 19:58:22.133766 26324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: Bootstrap starting.
I20260807 19:58:22.137959 26324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: Neither blocks nor log segments found. Creating new log.
W20260807 19:58:22.138912 26137 tablet.cc:2369] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:58:22.139389 26324 log.cc:824] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:22.142712 26324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: No bootstrap required, opened a new log
I20260807 19:58:22.153580 26324 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:22.153983 26324 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:22.154099 26324 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7e1945c88c4212868b87f8bdb7b065, State: Initialized, Role: FOLLOWER
I20260807 19:58:22.154747 26324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:22.157017 26324 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:22.159775 26491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.160245 26491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:58:22.174561 26224 master_runner.cc:263] No leader master found from master 3c7e1945c88c4212868b87f8bdb7b065
I20260807 19:58:22.174707 26224 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 19:58:22.186450 26506 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:58:22.186606 26506 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:58:22.245779 26452 raft_consensus.cc:482] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:58:22.246115 26452 raft_consensus.cc:504] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:22.247763 26452 leader_election.cc:288] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f1a66de062f49f6919297a22c47d9a0 (127.5.197.190:34671), 3c7e1945c88c4212868b87f8bdb7b065 (127.5.197.189:40437)
I20260807 19:58:22.249069 26173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f76dc91062c74245834adbc08c25ccbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f1a66de062f49f6919297a22c47d9a0" is_pre_election: true
I20260807 19:58:22.249680 26173 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76dc91062c74245834adbc08c25ccbd in term 0.
I20260807 19:58:22.250334 26291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f76dc91062c74245834adbc08c25ccbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e1945c88c4212868b87f8bdb7b065" is_pre_election: true
I20260807 19:58:22.250901 26291 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76dc91062c74245834adbc08c25ccbd in term 0.
I20260807 19:58:22.251864 26364 leader_election.cc:302] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f1a66de062f49f6919297a22c47d9a0, f76dc91062c74245834adbc08c25ccbd; no voters:
I20260807 19:58:22.252648 26452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:58:22.252807 26452 raft_consensus.cc:482] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:58:22.252900 26452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:22.256234 26452 raft_consensus.cc:504] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:22.256954 26452 leader_election.cc:288] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [CANDIDATE]: Term 1 election: Requested vote from peers 8f1a66de062f49f6919297a22c47d9a0 (127.5.197.190:34671), 3c7e1945c88c4212868b87f8bdb7b065 (127.5.197.189:40437)
I20260807 19:58:22.258008 26291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f76dc91062c74245834adbc08c25ccbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c7e1945c88c4212868b87f8bdb7b065"
I20260807 19:58:22.258242 26291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:22.261663 26291 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76dc91062c74245834adbc08c25ccbd in term 1.
I20260807 19:58:22.262315 26173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f76dc91062c74245834adbc08c25ccbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f1a66de062f49f6919297a22c47d9a0"
I20260807 19:58:22.262535 26173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:22.265832 26173 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76dc91062c74245834adbc08c25ccbd in term 1.
I20260807 19:58:22.266314 26364 leader_election.cc:302] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f1a66de062f49f6919297a22c47d9a0, f76dc91062c74245834adbc08c25ccbd; no voters:
I20260807 19:58:22.266906 26452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:22.275516 26452 raft_consensus.cc:686] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [term 1 LEADER]: Becoming Leader. State: Replica: f76dc91062c74245834adbc08c25ccbd, State: Running, Role: LEADER
I20260807 19:58:22.276170 26452 consensus_queue.cc:237] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } }
I20260807 19:58:22.286079 26510 sys_catalog.cc:455] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f76dc91062c74245834adbc08c25ccbd. Latest consensus state: current_term: 1 leader_uuid: "f76dc91062c74245834adbc08c25ccbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.286474 26510 sys_catalog.cc:458] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:22.294409 26515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:22.296876 26515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:22.316530 26291 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [term 1 FOLLOWER]: Refusing update from remote peer f76dc91062c74245834adbc08c25ccbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:22.317636 26510 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:22.324985 26173 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [term 1 FOLLOWER]: Refusing update from remote peer f76dc91062c74245834adbc08c25ccbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:22.325798 26510 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:22.348754 26491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f76dc91062c74245834adbc08c25ccbd. Latest consensus state: current_term: 1 leader_uuid: "f76dc91062c74245834adbc08c25ccbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.349073 26491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:58:22.352823 26516 mvcc.cc:205] Tried to move back new op lower bound from 7315999548676247552 to 7315999548528709632. Current Snapshot: MvccSnapshot[applied={T|T < 7315999548676247552}]
I20260807 19:58:22.358037 26471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f76dc91062c74245834adbc08c25ccbd. Latest consensus state: current_term: 1 leader_uuid: "f76dc91062c74245834adbc08c25ccbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.358390 26471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:58:22.358743 26491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f76dc91062c74245834adbc08c25ccbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.358978 26491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:58:22.364490 26452 sys_catalog.cc:455] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f76dc91062c74245834adbc08c25ccbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.364902 26452 sys_catalog.cc:458] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:22.366598 26515 catalog_manager.cc:1347] Generated new cluster ID: ae7ecd27d38c4d72a84e5c53ecaeb1a3
I20260807 19:58:22.366706 26515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:58:22.396276 26471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f76dc91062c74245834adbc08c25ccbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.396543 26471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:58:22.399964 26510 sys_catalog.cc:455] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f76dc91062c74245834adbc08c25ccbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f1a66de062f49f6919297a22c47d9a0" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34671 } } peers { permanent_uuid: "3c7e1945c88c4212868b87f8bdb7b065" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 40437 } } peers { permanent_uuid: "f76dc91062c74245834adbc08c25ccbd" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 34855 } } }
I20260807 19:58:22.400230 26510 sys_catalog.cc:458] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:22.410501 26515 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:58:22.412289 26515 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:58:22.429033 26515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f76dc91062c74245834adbc08c25ccbd: Generated new TSK 0
I20260807 19:58:22.429891 26515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:58:23.089033 26484 catalog_manager.cc:1259] Loaded cluster ID: ae7ecd27d38c4d72a84e5c53ecaeb1a3
I20260807 19:58:23.089138 26484 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: loading cluster ID for follower catalog manager: success
I20260807 19:58:23.091825 26484 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: acquiring CA information for follower catalog manager: success
I20260807 19:58:23.093571 26484 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8f1a66de062f49f6919297a22c47d9a0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:58:23.188720 26506 catalog_manager.cc:1259] Loaded cluster ID: ae7ecd27d38c4d72a84e5c53ecaeb1a3
I20260807 19:58:23.188827 26506 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: loading cluster ID for follower catalog manager: success
I20260807 19:58:23.191409 26506 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: acquiring CA information for follower catalog manager: success
I20260807 19:58:23.193238 26506 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3c7e1945c88c4212868b87f8bdb7b065: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:58:23.573545 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 26111
I20260807 19:58:23.575251 26207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:23.684885 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 26111
I20260807 19:58:23.713004 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 26224
I20260807 19:58:23.714090 26317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:23.819958 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 26224
I20260807 19:58:23.844064 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 26333
I20260807 19:58:23.845184 26424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:23.953822 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 26333
2026-08-07T19:58:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4947 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:58:24 dist-test-slave-6bbx krb5kdc[26540](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:58:24 dist-test-slave-6bbx krb5kdc[26540](info): set up 2 sockets
Aug 07 19:58:24 dist-test-slave-6bbx krb5kdc[26540](info): commencing operation
krb5kdc: starting...
W20260807 19:58:25.157552 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:58:25 dist-test-slave-6bbx krb5kdc[26540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:58:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:58:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:58:25.418906 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40669
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:40669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:25.752053 26557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:25.752342 26557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:25.752478 26557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:25.759434 26557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:25.759539 26557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:25.759618 26557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:25.759711 26557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:25.759774 26557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:25.769263 26557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:40669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:25.770551 26557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:25.771909 26557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:25.783346 26569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:25.783319 26567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:25.783506 26566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:25.784303 26557 server_base.cc:1034] running on GCE node
I20260807 19:58:25.785056 26557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:25.786406 26557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:25.787600 26557 hybrid_clock.cc:648] HybridClock initialized: now 1786132705787543 us; error 44 us; skew 500 ppm
I20260807 19:58:25.787964 26557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:25 dist-test-slave-6bbx krb5kdc[26540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132705, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:25.794389 26557 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:25.795827 26557 webserver.cc:460] Webserver started at http://127.5.197.190:42663/ using document root <none> and password file <none>
I20260807 19:58:25.796499 26557 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:25.796613 26557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:25.796900 26557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:25.799933 26557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "ec873e58a5e644d6b6d3f8301976c070"
format_stamp: "Formatted at 2026-08-07 19:58:25 on dist-test-slave-6bbx"
server_key: "d8b8b4c7544a2576bb1c644f13202e42"
server_key_iv: "1ccde08f9602fadc216570bab1c371cf"
server_key_version: "encryptionkey@0"
I20260807 19:58:25.800689 26557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "ec873e58a5e644d6b6d3f8301976c070"
format_stamp: "Formatted at 2026-08-07 19:58:25 on dist-test-slave-6bbx"
server_key: "d8b8b4c7544a2576bb1c644f13202e42"
server_key_iv: "1ccde08f9602fadc216570bab1c371cf"
server_key_version: "encryptionkey@0"
I20260807 19:58:25.806092 26557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:58:25.809624 26581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:25.810952 26557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:58:25.811105 26557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "ec873e58a5e644d6b6d3f8301976c070"
format_stamp: "Formatted at 2026-08-07 19:58:25 on dist-test-slave-6bbx"
server_key: "d8b8b4c7544a2576bb1c644f13202e42"
server_key_iv: "1ccde08f9602fadc216570bab1c371cf"
server_key_version: "encryptionkey@0"
I20260807 19:58:25.811280 26557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:25.837656 26557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:25.841641 26557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:25.841920 26557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:25.859416 26557 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:40669
I20260807 19:58:25.859423 26664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:40669 every 8 connection(s)
I20260807 19:58:25.860862 26557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:25.862401 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 26557
I20260807 19:58:25.862633 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:58:25.863533 5910 external_mini_cluster.cc:1428] Setting key f2929eed7e600f5c91364e65390a0468
I20260807 19:58:25.865684 26666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:58:25 dist-test-slave-6bbx krb5kdc[26540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:25.878736 26666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070: Bootstrap starting.
I20260807 19:58:25.882323 26666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:25.883373 26666 log.cc:824] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:25.886917 26666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070: No bootstrap required, opened a new log
I20260807 19:58:25.887854 26669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:25.865500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56538 (local address 127.5.197.190:40669)
0807 19:58:25.866279 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:25.866295 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:25.866345 (+ 50us) server_negotiation.cc:407] Connection header received
0807 19:58:25.868583 (+ 2238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:25.868612 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:25.869132 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:25.869582 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:25.871009 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:25.873077 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:25.874487 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:25.875528 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:25.875762 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:25.880179 (+ 4417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:25.880187 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:25.880202 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:25.880244 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:25.883286 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:25.884291 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:25.884300 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:25.884308 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:25.884568 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:25.885054 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:25.885058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:25.885060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:25.885608 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:25.885838 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:25.886305 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 19:58:25.886629 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":319,"threads_started":1}
I20260807 19:58:25.891755 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:58:25.894791 26666 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec873e58a5e644d6b6d3f8301976c070" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40669 } }
I20260807 19:58:25.895144 26666 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:25.895237 26666 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec873e58a5e644d6b6d3f8301976c070, State: Initialized, Role: FOLLOWER
I20260807 19:58:25.895860 26666 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec873e58a5e644d6b6d3f8301976c070" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40669 } }
I20260807 19:58:25.896076 26666 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:58:25.896201 26666 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:58:25.896353 26666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:25.898429 26666 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec873e58a5e644d6b6d3f8301976c070" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40669 } }
I20260807 19:58:25.898890 26666 leader_election.cc:302] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec873e58a5e644d6b6d3f8301976c070; no voters:
I20260807 19:58:25.899436 26666 leader_election.cc:288] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:58:25.899550 26672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:25.900233 26672 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [term 1 LEADER]: Becoming Leader. State: Replica: ec873e58a5e644d6b6d3f8301976c070, State: Running, Role: LEADER
I20260807 19:58:25.900770 26672 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec873e58a5e644d6b6d3f8301976c070" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40669 } }
I20260807 19:58:25.901389 26666 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:25.903349 26675 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec873e58a5e644d6b6d3f8301976c070. Latest consensus state: current_term: 1 leader_uuid: "ec873e58a5e644d6b6d3f8301976c070" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec873e58a5e644d6b6d3f8301976c070" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40669 } } }
I20260807 19:58:25.903309 26673 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec873e58a5e644d6b6d3f8301976c070" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec873e58a5e644d6b6d3f8301976c070" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40669 } } }
I20260807 19:58:25.903748 26675 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:25.903800 26673 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:25.905865 26681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:25.910029 26681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:25.918478 26681 catalog_manager.cc:1347] Generated new cluster ID: 856d474ac8074a4d940d4f29e93b8a29
I20260807 19:58:25.918591 26681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:58:25.957962 26681 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:58:25.959260 26681 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:58:25.968885 26681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec873e58a5e644d6b6d3f8301976c070: Generated new TSK 0
I20260807 19:58:25.969712 26681 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:58:26.004172 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 26557
I20260807 19:58:26.005474 26656 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:26.101100 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 26557
2026-08-07T19:58:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2144 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:58:26 dist-test-slave-6bbx krb5kdc[26710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:58:26 dist-test-slave-6bbx krb5kdc[26710](info): set up 2 sockets
Aug 07 19:58:26 dist-test-slave-6bbx krb5kdc[26710](info): commencing operation
krb5kdc: starting...
W20260807 19:58:27.295259 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.009s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:58:27 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:58:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:58:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:58:27.577271 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43119
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:43119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:27.917783 26726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:27.918083 26726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:27.918226 26726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:27.925340 26726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:27.925458 26726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:27.925549 26726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:27.925625 26726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:27.925688 26726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:27.935256 26726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:43119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:27.936563 26726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:27.937855 26726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:27.949357 26736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:27.949330 26733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:27.949397 26734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:27.950519 26726 server_base.cc:1034] running on GCE node
I20260807 19:58:27.951303 26726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:27.952755 26726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:27.953971 26726 hybrid_clock.cc:648] HybridClock initialized: now 1786132707953909 us; error 43 us; skew 500 ppm
I20260807 19:58:27.954312 26726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:27 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132707, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:27.957382 26726 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:27.958806 26726 webserver.cc:460] Webserver started at http://127.5.197.190:41373/ using document root <none> and password file <none>
I20260807 19:58:27.959478 26726 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:27.959600 26726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:27.959925 26726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:27.962890 26726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "0e2cabc4fc5348f4afe932a1f249b079"
format_stamp: "Formatted at 2026-08-07 19:58:27 on dist-test-slave-6bbx"
server_key: "e47a1e730da2c9dc9525465e6b1dcd2b"
server_key_iv: "533c6b9203ae86fa055a9ab62a9ce8d6"
server_key_version: "encryptionkey@0"
I20260807 19:58:27.963626 26726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "0e2cabc4fc5348f4afe932a1f249b079"
format_stamp: "Formatted at 2026-08-07 19:58:27 on dist-test-slave-6bbx"
server_key: "e47a1e730da2c9dc9525465e6b1dcd2b"
server_key_iv: "533c6b9203ae86fa055a9ab62a9ce8d6"
server_key_version: "encryptionkey@0"
I20260807 19:58:27.968534 26726 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:58:27.971791 26744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:27.973013 26726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:27.973165 26726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "0e2cabc4fc5348f4afe932a1f249b079"
format_stamp: "Formatted at 2026-08-07 19:58:27 on dist-test-slave-6bbx"
server_key: "e47a1e730da2c9dc9525465e6b1dcd2b"
server_key_iv: "533c6b9203ae86fa055a9ab62a9ce8d6"
server_key_version: "encryptionkey@0"
I20260807 19:58:27.973354 26726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:28.030761 26726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:28.034921 26726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:28.035336 26726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:28.052753 26726 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:43119
I20260807 19:58:28.052788 26826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:43119 every 8 connection(s)
I20260807 19:58:28.054044 26726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:28.054414 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 26726
I20260807 19:58:28.054600 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:58:28.055409 5910 external_mini_cluster.cc:1428] Setting key ce5034592788e3f6bf0f6c744137e701
I20260807 19:58:28.058442 26827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:58:28 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:28.070600 26827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Bootstrap starting.
I20260807 19:58:28.073741 26827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:28.074977 26827 log.cc:824] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:28.078186 26827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: No bootstrap required, opened a new log
I20260807 19:58:28.078279 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:28.057430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49872 (local address 127.5.197.190:43119)
0807 19:58:28.058217 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:28.058231 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:28.058280 (+ 49us) server_negotiation.cc:407] Connection header received
0807 19:58:28.060517 (+ 2237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:28.060544 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:28.060987 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:28.061412 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:28.062667 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:28.064700 (+ 2033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:28.065978 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:28.066936 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:28.067107 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:28.071090 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:28.071098 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:28.071110 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:28.071147 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:28.073965 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:28.074815 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:28.074821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:28.074826 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:28.075005 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:28.075427 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:28.075432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:28.075435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:28.076212 (+ 777us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:28.076477 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:28.076912 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 19:58:28.077255 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":314,"threads_started":1}
I20260807 19:58:28.086277 26827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:28.086617 26827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:28.086711 26827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2cabc4fc5348f4afe932a1f249b079, State: Initialized, Role: FOLLOWER
I20260807 19:58:28.087297 26827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:28.087579 26827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:58:28.087741 26827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:58:28.087924 26827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:28.090528 26827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:28.090987 26827 leader_election.cc:302] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e2cabc4fc5348f4afe932a1f249b079; no voters:
I20260807 19:58:28.091493 26827 leader_election.cc:288] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:58:28.091622 26834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:28.092279 26834 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 LEADER]: Becoming Leader. State: Replica: 0e2cabc4fc5348f4afe932a1f249b079, State: Running, Role: LEADER
I20260807 19:58:28.092834 26834 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:28.093465 26827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:28.095774 26836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e2cabc4fc5348f4afe932a1f249b079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } } }
I20260807 19:58:28.095844 26837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e2cabc4fc5348f4afe932a1f249b079. Latest consensus state: current_term: 1 leader_uuid: "0e2cabc4fc5348f4afe932a1f249b079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } } }
I20260807 19:58:28.096184 26837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:28.096185 26836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:28.103523 26846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:28.109010 26846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:28.117486 26846 catalog_manager.cc:1347] Generated new cluster ID: 08d536d39eeb41a0a965b3d3ea28a3f5
I20260807 19:58:28.117595 26846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:58:28.127465 26846 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:58:28.128696 26846 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:58:28.139628 26846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Generated new TSK 0
I20260807 19:58:28.140388 26846 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:58:28.215076 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:43119
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:28.551128 26868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:28.551374 26868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:28.551473 26868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:28.558856 26868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:28.558955 26868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:28.559074 26868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:58:28.568394 26868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:28.569566 26868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:28.570838 26868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:28.583911 26875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:28.583854 26877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:28.583948 26881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:28.584889 26868 server_base.cc:1034] running on GCE node
I20260807 19:58:28.585480 26868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:28.586381 26868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:28.587584 26868 hybrid_clock.cc:648] HybridClock initialized: now 1786132708587527 us; error 49 us; skew 500 ppm
I20260807 19:58:28.587925 26868 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:28 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132708, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:28.590862 26868 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:58:28.592286 26868 webserver.cc:460] Webserver started at http://127.5.197.129:44297/ using document root <none> and password file <none>
I20260807 19:58:28.592952 26868 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:28.593072 26868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:28.593369 26868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:28.596247 26868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "a4616027b8884e6a8301e035c2d35202"
format_stamp: "Formatted at 2026-08-07 19:58:28 on dist-test-slave-6bbx"
server_key: "2482f2a8265ee08c5f6521ec4de6b24b"
server_key_iv: "818de18450cb0f7f9b488fe9630f233e"
server_key_version: "encryptionkey@0"
I20260807 19:58:28.596978 26868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "a4616027b8884e6a8301e035c2d35202"
format_stamp: "Formatted at 2026-08-07 19:58:28 on dist-test-slave-6bbx"
server_key: "2482f2a8265ee08c5f6521ec4de6b24b"
server_key_iv: "818de18450cb0f7f9b488fe9630f233e"
server_key_version: "encryptionkey@0"
I20260807 19:58:28.602352 26868 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:58:28.605877 26895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:28.607086 26868 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260807 19:58:28.607231 26868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "a4616027b8884e6a8301e035c2d35202"
format_stamp: "Formatted at 2026-08-07 19:58:28 on dist-test-slave-6bbx"
server_key: "2482f2a8265ee08c5f6521ec4de6b24b"
server_key_iv: "818de18450cb0f7f9b488fe9630f233e"
server_key_version: "encryptionkey@0"
I20260807 19:58:28.607411 26868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:28.620329 26868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:28.623956 26868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:28.624207 26868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:28.625083 26868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:28.626830 26868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:28.626956 26868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 19:58:28.627085 26868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:28.627153 26868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:28.666903 26868 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:36281
I20260807 19:58:28.666956 27068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:36281 every 8 connection(s)
I20260807 19:58:28.668592 26868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:58:28.672478 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 26868
I20260807 19:58:28.672708 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:58:28.673560 5910 external_mini_cluster.cc:1428] Setting key 0ea8d8820c74caa6754f0bc667cc9861
Aug 07 19:58:28 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132708, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:28.692544 27073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:28.671635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:44859 (local address 127.5.197.190:43119)
0807 19:58:28.674782 (+ 3147us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:28.674789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:28.674813 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:58:28.675315 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:28.675322 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:28.675417 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:28.675540 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:28.677928 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:28.679107 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:28.681625 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:28.682261 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:28.682405 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:28.686660 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:28.686665 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:28.686668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:28.686700 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:28.689517 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:28.690347 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:28.690350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:28.690352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:28.690475 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:28.690912 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:28.690915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:28.690917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:28.691153 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:28.691258 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:28.692114 (+ 856us) server_negotiation.cc:299] Negotiation successful
0807 19:58:28.692272 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3017,"thread_start_us":227,"threads_started":1}
I20260807 19:58:28.693895 27074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:28.672217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:44859)
0807 19:58:28.673088 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:28.673145 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:28.675007 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:28.676000 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:28.676014 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:28.676808 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:28.677705 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:28.677735 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:28.679326 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:28.679332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:28.681433 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:28.681450 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:28.682726 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:28.682734 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:28.683035 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:28.683864 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:28.683898 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:28.686434 (+ 2536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:28.689657 (+ 3223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:28.689664 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:28.689676 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:28.690229 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:28.690570 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:28.690574 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:28.690577 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:28.690820 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:28.691277 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:28.691284 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:28.691704 (+ 420us) client_negotiation.cc:769] Sending connection context
0807 19:58:28.692040 (+ 336us) client_negotiation.cc:240] Negotiation successful
0807 19:58:28.692559 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":350,"threads_started":1}
I20260807 19:58:28.695408 27070 heartbeater.cc:347] Connected to a master server at 127.5.197.190:43119
I20260807 19:58:28.695724 27070 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:28.696425 27070 heartbeater.cc:511] Master 127.5.197.190:43119 requested a full tablet report, sending...
I20260807 19:58:28.698432 26775 ts_manager.cc:194] Registered new tserver with Master: a4616027b8884e6a8301e035c2d35202 (127.5.197.129:36281)
I20260807 19:58:28.699878 26775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:44859
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:58:28.737175 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:43119
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:29.071575 27077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:29.071899 27077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:29.072041 27077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:29.081379 27077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:29.081504 27077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:29.081691 27077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:58:29.092461 27077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:29.093691 27077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:29.094983 27077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:29.107560 27084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:29.107589 27087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:29.107800 27089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:29.108349 27077 server_base.cc:1034] running on GCE node
I20260807 19:58:29.108927 27077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:29.109812 27077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:29.111037 27077 hybrid_clock.cc:648] HybridClock initialized: now 1786132709110977 us; error 52 us; skew 500 ppm
I20260807 19:58:29.111367 27077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:29 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132709, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:29.114480 27077 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:58:29.115852 27077 webserver.cc:460] Webserver started at http://127.5.197.130:39079/ using document root <none> and password file <none>
I20260807 19:58:29.116504 27077 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:29.116621 27077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:29.116904 27077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:29.119800 27077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "19a85696bcd34fcb83430cdc2ff43cc1"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "a64a1adf1552fa2de0e9758dcd2c9ddb"
server_key_iv: "c4e5823e8a22769acfd4d3d1576c94dd"
server_key_version: "encryptionkey@0"
I20260807 19:58:29.120586 27077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "19a85696bcd34fcb83430cdc2ff43cc1"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "a64a1adf1552fa2de0e9758dcd2c9ddb"
server_key_iv: "c4e5823e8a22769acfd4d3d1576c94dd"
server_key_version: "encryptionkey@0"
I20260807 19:58:29.125500 27077 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260807 19:58:29.128796 27098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:29.130010 27077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:58:29.130155 27077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "19a85696bcd34fcb83430cdc2ff43cc1"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "a64a1adf1552fa2de0e9758dcd2c9ddb"
server_key_iv: "c4e5823e8a22769acfd4d3d1576c94dd"
server_key_version: "encryptionkey@0"
I20260807 19:58:29.130359 27077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:29.152318 27077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:29.156215 27077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:29.156476 27077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:29.157392 27077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:29.158706 27077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:29.158790 27077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:29.158913 27077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:29.158967 27077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:29.189831 27077 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41291
I20260807 19:58:29.189900 27287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41291 every 8 connection(s)
I20260807 19:58:29.191133 27077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:58:29.201395 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 27077
I20260807 19:58:29.201597 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:58:29.202212 5910 external_mini_cluster.cc:1428] Setting key 8c6030f53f78d007cac35fa7e706b7f1
Aug 07 19:58:29 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132709, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:29.210639 27290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.193655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:54971 (local address 127.5.197.190:43119)
0807 19:58:29.194100 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:29.194107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:29.195174 (+ 1067us) server_negotiation.cc:407] Connection header received
0807 19:58:29.197046 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:29.197051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:29.197118 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:29.197214 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:29.198642 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.199318 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.200823 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.201248 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.201336 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.205159 (+ 3823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:29.205163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:29.205167 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:29.205198 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:29.207704 (+ 2506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:29.208401 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:29.208404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:29.208407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:29.208533 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:29.208953 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:29.208956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:29.208958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:29.209211 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:29.209344 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:29.210020 (+ 676us) server_negotiation.cc:299] Negotiation successful
0807 19:58:29.210277 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":209,"threads_started":1}
I20260807 19:58:29.211593 27291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.194194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:54971)
0807 19:58:29.195013 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:29.195061 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:29.196790 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:29.197438 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:29.197446 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:29.197938 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:29.198506 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.198525 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.199449 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.199452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.200713 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.200727 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.201482 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.201490 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.201779 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.202534 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:29.202566 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:29.204949 (+ 2383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:29.207829 (+ 2880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:29.207839 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:29.207854 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:29.208269 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:29.208638 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:29.208643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:29.208647 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:29.208832 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:29.209336 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:29.209343 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:29.209665 (+ 322us) client_negotiation.cc:769] Sending connection context
0807 19:58:29.209901 (+ 236us) client_negotiation.cc:240] Negotiation successful
0807 19:58:29.210398 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":290,"threads_started":1}
I20260807 19:58:29.212921 27288 heartbeater.cc:347] Connected to a master server at 127.5.197.190:43119
I20260807 19:58:29.213267 27288 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:29.214072 27288 heartbeater.cc:511] Master 127.5.197.190:43119 requested a full tablet report, sending...
I20260807 19:58:29.215636 26775 ts_manager.cc:194] Registered new tserver with Master: 19a85696bcd34fcb83430cdc2ff43cc1 (127.5.197.130:41291)
I20260807 19:58:29.216455 26775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:54971
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:58:29.265120 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:43119
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:29.604347 27294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:29.604631 27294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:29.604770 27294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:29.612114 27294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:29.612237 27294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:29.612402 27294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:58:29.622287 27294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:29.623615 27294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:29.625011 27294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:29.637728 27304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:29.637763 27312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:29.637745 27306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:29.638645 27294 server_base.cc:1034] running on GCE node
I20260807 19:58:29.639253 27294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:29.640193 27294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:29.641399 27294 hybrid_clock.cc:648] HybridClock initialized: now 1786132709641350 us; error 41 us; skew 500 ppm
I20260807 19:58:29.641697 27294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:29 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132709, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:29.644865 27294 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:58:29.646232 27294 webserver.cc:460] Webserver started at http://127.5.197.131:38189/ using document root <none> and password file <none>
I20260807 19:58:29.647078 27294 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:29.647217 27294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:29.647526 27294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:29.650574 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "e80c979b07be45e5bd871a051947fb99"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "b1a0d03c3ed9831a6b9e352d72bdb6d7"
server_key_iv: "2082ea5b0a33be2c5ca5c7d1990ec21a"
server_key_version: "encryptionkey@0"
I20260807 19:58:29.651391 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "e80c979b07be45e5bd871a051947fb99"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "b1a0d03c3ed9831a6b9e352d72bdb6d7"
server_key_iv: "2082ea5b0a33be2c5ca5c7d1990ec21a"
server_key_version: "encryptionkey@0"
I20260807 19:58:29.656514 27294 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260807 19:58:29.659901 27323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:29.661156 27294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:58:29.661324 27294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "e80c979b07be45e5bd871a051947fb99"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "b1a0d03c3ed9831a6b9e352d72bdb6d7"
server_key_iv: "2082ea5b0a33be2c5ca5c7d1990ec21a"
server_key_version: "encryptionkey@0"
I20260807 19:58:29.661522 27294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:29.685385 27294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:29.689728 27294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:29.690012 27294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:29.691018 27294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:29.692480 27294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:29.692579 27294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:29.692709 27294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:29.692765 27294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:29.702746 27070 heartbeater.cc:503] Master 127.5.197.190:43119 was elected leader, sending a full tablet report...
I20260807 19:58:29.723378 27294 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39321
I20260807 19:58:29.723423 27510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39321 every 8 connection(s)
I20260807 19:58:29.724720 27294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:58:29.732806 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 27294
I20260807 19:58:29.733000 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:58:29.733500 5910 external_mini_cluster.cc:1428] Setting key 9b8afa1614f3a93041b41f0758979cfd
Aug 07 19:58:29 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132709, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:29.744616 27518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.727210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:55197 (local address 127.5.197.190:43119)
0807 19:58:29.727739 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:29.727744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:29.728612 (+ 868us) server_negotiation.cc:407] Connection header received
0807 19:58:29.730393 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:29.730397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:29.730465 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:29.730560 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:29.732061 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.733110 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.734933 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.735442 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.735567 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.739040 (+ 3473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:29.739045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:29.739048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:29.739082 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:29.741541 (+ 2459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:29.742242 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:29.742246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:29.742249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:29.742369 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:29.742775 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:29.742778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:29.742780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:29.743055 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:29.743203 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:29.744022 (+ 819us) server_negotiation.cc:299] Negotiation successful
0807 19:58:29.744244 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":226,"threads_started":1}
I20260807 19:58:29.745597 27519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.727756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:55197)
0807 19:58:29.728456 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:29.728495 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:29.730149 (+ 1654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:29.730768 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:29.730775 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:29.731278 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:29.731918 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.731939 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.733260 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.733264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.734767 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.734796 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.735694 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.735703 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.735953 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.736607 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:29.736638 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:29.738836 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:29.741675 (+ 2839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:29.741684 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:29.741701 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:29.742108 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:29.742470 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:29.742476 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:29.742480 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:29.742662 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:29.743183 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:29.743191 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:29.743587 (+ 396us) client_negotiation.cc:769] Sending connection context
0807 19:58:29.743886 (+ 299us) client_negotiation.cc:240] Negotiation successful
0807 19:58:29.744427 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":247,"threads_started":1}
I20260807 19:58:29.747020 27513 heartbeater.cc:347] Connected to a master server at 127.5.197.190:43119
I20260807 19:58:29.747364 27513 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:29.748124 27513 heartbeater.cc:511] Master 127.5.197.190:43119 requested a full tablet report, sending...
I20260807 19:58:29.749538 26775 ts_manager.cc:194] Registered new tserver with Master: e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321)
I20260807 19:58:29.750321 26775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:55197
I20260807 19:58:29.760839 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:58:29.777070 27518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.765309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.5.197.190:43119)
0807 19:58:29.765472 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:29.765476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:29.765846 (+ 370us) server_negotiation.cc:407] Connection header received
0807 19:58:29.766025 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:29.766028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:29.766090 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:29.766155 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:29.767499 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.768294 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.769537 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.769962 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.770049 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.772295 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:29.772300 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:29.772303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:29.772336 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:29.774782 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:29.775386 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:29.775389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:29.775392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:29.775498 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:29.775805 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:29.775808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:29.775810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:29.776120 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:29.776293 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:29.776593 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 19:58:29.776820 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 19:58:29.781097 26775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:58:29.788058 26775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:58:29.809825 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.800189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60490 (local address 127.5.197.130:41291)
0807 19:58:29.800695 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:29.800705 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:29.801450 (+ 745us) server_negotiation.cc:407] Connection header received
0807 19:58:29.801861 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:29.801870 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:29.802128 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:29.802353 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:29.803291 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.804913 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.807548 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.808696 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.808838 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.809056 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:29.809342 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 19:58:29.809513 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":246,"threads_started":1}
I20260807 19:58:29.809867 27540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.799997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41291 (local address 127.0.0.1:60490)
0807 19:58:29.801305 (+ 1308us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:29.801350 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:29.801550 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:29.802637 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:29.802644 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:29.802678 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:29.803070 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.803084 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.805047 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.805052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.807359 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.807374 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.808910 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.808919 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.809103 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.809160 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 19:58:29.809269 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 19:58:29.809455 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1065,"mutex_wait_us":1,"thread_start_us":908,"threads_started":1}
I20260807 19:58:29.811337 27542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.801772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39321 (local address 127.0.0.1:43828)
0807 19:58:29.802496 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:29.802512 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:29.802612 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:29.804363 (+ 1751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:29.804368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:29.804399 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:29.804860 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.804872 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.806412 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.806417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.808552 (+ 2135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.808568 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.810318 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.810325 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.810514 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.810548 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:58:29.810617 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 19:58:29.810760 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":23,"thread_start_us":951,"threads_started":1}
I20260807 19:58:29.811921 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.802398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43828 (local address 127.5.197.131:39321)
0807 19:58:29.803353 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:29.803362 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:29.803738 (+ 376us) server_negotiation.cc:407] Connection header received
0807 19:58:29.803915 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:29.803923 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:29.804130 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:29.805050 (+ 920us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:29.805274 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.806265 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.808728 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.810087 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.810885 (+ 798us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.811102 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:29.811159 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 19:58:29.811317 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":564,"threads_started":1}
I20260807 19:58:29.812415 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.801278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:36281 (local address 127.0.0.1:49170)
0807 19:58:29.801882 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:29.801898 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:29.801994 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:29.804297 (+ 2303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:29.804302 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:29.804327 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:29.804784 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.804794 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.806893 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.806898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.809024 (+ 2126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:29.809037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.811034 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.811042 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:29.811231 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.811264 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:58:29.811353 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 19:58:29.811474 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":4,"thread_start_us":863,"threads_started":1}
I20260807 19:58:29.813340 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:29.801896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49170 (local address 127.5.197.129:36281)
0807 19:58:29.803729 (+ 1833us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:29.803737 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:29.803763 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:58:29.803854 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:29.803861 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:29.804081 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:29.804944 (+ 863us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:29.805201 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.806751 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.809187 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:29.810710 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:29.812634 (+ 1924us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:29.812830 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:29.812884 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 19:58:29.813035 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1667,"thread_start_us":1520,"threads_started":1}
I20260807 19:58:29.814505 27196 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 (DEFAULT_TABLE table=test-table [id=a45a6905a0004945b8b13146c43e7466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:29.815147 27399 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 (DEFAULT_TABLE table=test-table [id=a45a6905a0004945b8b13146c43e7466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:29.815786 27196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:29.816330 27399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:29.820043 26967 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 (DEFAULT_TABLE table=test-table [id=a45a6905a0004945b8b13146c43e7466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:29.821516 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:29.827132 27546 tablet_bootstrap.cc:492] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Bootstrap starting.
I20260807 19:58:29.830483 27546 tablet_bootstrap.cc:654] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:29.831456 27546 log.cc:824] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:29.834854 27548 tablet_bootstrap.cc:492] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Bootstrap starting.
I20260807 19:58:29.837280 27550 tablet_bootstrap.cc:492] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Bootstrap starting.
I20260807 19:58:29.838460 27546 tablet_bootstrap.cc:492] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: No bootstrap required, opened a new log
I20260807 19:58:29.838773 27546 ts_tablet_manager.cc:1397] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260807 19:58:29.839076 27548 tablet_bootstrap.cc:654] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:29.840211 27550 tablet_bootstrap.cc:654] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:29.840390 27548 log.cc:824] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:29.841259 27550 log.cc:824] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:29.843367 27548 tablet_bootstrap.cc:492] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: No bootstrap required, opened a new log
I20260807 19:58:29.843715 27548 ts_tablet_manager.cc:1397] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 19:58:29.843797 27550 tablet_bootstrap.cc:492] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: No bootstrap required, opened a new log
I20260807 19:58:29.844025 27550 ts_tablet_manager.cc:1397] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260807 19:58:29.848794 27546 raft_consensus.cc:348] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:29.849227 27546 raft_consensus.cc:374] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:29.849323 27546 raft_consensus.cc:729] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80c979b07be45e5bd871a051947fb99, State: Initialized, Role: FOLLOWER
I20260807 19:58:29.849936 27546 consensus_queue.cc:260] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:29.851035 27513 heartbeater.cc:503] Master 127.5.197.190:43119 was elected leader, sending a full tablet report...
I20260807 19:58:29.851656 27546 ts_tablet_manager.cc:1428] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260807 19:58:29.851457 27550 raft_consensus.cc:348] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:29.851876 27550 raft_consensus.cc:374] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:29.851964 27550 raft_consensus.cc:729] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4616027b8884e6a8301e035c2d35202, State: Initialized, Role: FOLLOWER
I20260807 19:58:29.852535 27550 consensus_queue.cc:260] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:29.853515 27548 raft_consensus.cc:348] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:29.853845 27548 raft_consensus.cc:374] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:29.853942 27548 raft_consensus.cc:729] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a85696bcd34fcb83430cdc2ff43cc1, State: Initialized, Role: FOLLOWER
I20260807 19:58:29.854470 27548 consensus_queue.cc:260] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:29.856134 27550 ts_tablet_manager.cc:1428] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Time spent starting tablet: real 0.012s user 0.007s sys 0.003s
I20260807 19:58:29.857157 27288 heartbeater.cc:503] Master 127.5.197.190:43119 was elected leader, sending a full tablet report...
I20260807 19:58:29.857677 27548 ts_tablet_manager.cc:1428] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
W20260807 19:58:29.921100 27072 tablet.cc:2369] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:58:29.943085 27289 tablet.cc:2369] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:58:29.976267 27515 tablet.cc:2369] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:58:30.070338 27555 raft_consensus.cc:482] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:58:30.070622 27555 raft_consensus.cc:504] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:30.072417 27555 leader_election.cc:288] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a85696bcd34fcb83430cdc2ff43cc1 (127.5.197.130:41291), e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321)
I20260807 19:58:30.080066 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.072924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:36645 (local address 127.5.197.130:41291)
0807 19:58:30.073115 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:30.073120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:30.073699 (+ 579us) server_negotiation.cc:407] Connection header received
0807 19:58:30.073813 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:30.073819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:30.073897 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:30.074001 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:30.074835 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.075811 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.078196 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.079261 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.079422 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.079497 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:30.079733 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 19:58:30.079861 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 19:58:30.080166 27559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.072832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41291 (local address 127.5.197.129:36645)
0807 19:58:30.073508 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:30.073528 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:30.073676 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:30.074192 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:30.074197 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:30.074231 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:30.074692 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:30.074704 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.075928 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.075932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:30.078043 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:30.078059 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.079443 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.079448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:30.079561 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.079586 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:58:30.079658 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 19:58:30.079819 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":364,"threads_started":1}
I20260807 19:58:30.080596 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.073899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:42595 (local address 127.5.197.131:39321)
0807 19:58:30.074134 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:30.074140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:30.074605 (+ 465us) server_negotiation.cc:407] Connection header received
0807 19:58:30.074770 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:30.074775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:30.074850 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:30.074962 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:30.075404 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.076334 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.078557 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.079651 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.079824 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.079901 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:30.080259 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 19:58:30.080398 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:58:30.081063 27560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.073688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39321 (local address 127.5.197.129:42595)
0807 19:58:30.074504 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:30.074521 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:30.074658 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:30.074979 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:30.074982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:30.075001 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:30.075253 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:30.075261 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.076467 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.076473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:30.078421 (+ 1948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:30.078432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.079881 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.079887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:30.080053 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.080083 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 19:58:30.080750 (+ 667us) client_negotiation.cc:240] Negotiation successful
0807 19:58:30.080853 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":404,"threads_started":1}
I20260807 19:58:30.081147 27221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8c94cec2dd4dec94c9e7c9f19c0166" candidate_uuid: "a4616027b8884e6a8301e035c2d35202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" is_pre_election: true
I20260807 19:58:30.081650 27221 raft_consensus.cc:2454] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4616027b8884e6a8301e035c2d35202 in term 0.
I20260807 19:58:30.081981 27433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8c94cec2dd4dec94c9e7c9f19c0166" candidate_uuid: "a4616027b8884e6a8301e035c2d35202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80c979b07be45e5bd871a051947fb99" is_pre_election: true
I20260807 19:58:30.082329 26900 leader_election.cc:302] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a85696bcd34fcb83430cdc2ff43cc1, a4616027b8884e6a8301e035c2d35202; no voters:
I20260807 19:58:30.082566 27433 raft_consensus.cc:2454] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4616027b8884e6a8301e035c2d35202 in term 0.
I20260807 19:58:30.082762 27555 raft_consensus.cc:2781] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:58:30.082911 27555 raft_consensus.cc:482] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:58:30.083034 27555 raft_consensus.cc:3037] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:30.085273 27555 raft_consensus.cc:504] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:30.085820 27555 leader_election.cc:288] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [CANDIDATE]: Term 1 election: Requested vote from peers 19a85696bcd34fcb83430cdc2ff43cc1 (127.5.197.130:41291), e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321)
I20260807 19:58:30.086236 27221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8c94cec2dd4dec94c9e7c9f19c0166" candidate_uuid: "a4616027b8884e6a8301e035c2d35202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a85696bcd34fcb83430cdc2ff43cc1"
I20260807 19:58:30.086266 27433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8c94cec2dd4dec94c9e7c9f19c0166" candidate_uuid: "a4616027b8884e6a8301e035c2d35202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80c979b07be45e5bd871a051947fb99"
I20260807 19:58:30.086417 27221 raft_consensus.cc:3037] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:30.086423 27433 raft_consensus.cc:3037] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:30.088579 27433 raft_consensus.cc:2454] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4616027b8884e6a8301e035c2d35202 in term 1.
I20260807 19:58:30.088718 27221 raft_consensus.cc:2454] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4616027b8884e6a8301e035c2d35202 in term 1.
I20260807 19:58:30.088920 26900 leader_election.cc:302] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4616027b8884e6a8301e035c2d35202, e80c979b07be45e5bd871a051947fb99; no voters:
I20260807 19:58:30.089193 27555 raft_consensus.cc:2781] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:30.089598 27555 raft_consensus.cc:686] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 1 LEADER]: Becoming Leader. State: Replica: a4616027b8884e6a8301e035c2d35202, State: Running, Role: LEADER
I20260807 19:58:30.090126 27555 consensus_queue.cc:237] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } }
I20260807 19:58:30.095090 26775 catalog_manager.cc:5495] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4616027b8884e6a8301e035c2d35202 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "a4616027b8884e6a8301e035c2d35202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } health_report { overall_health: HEALTHY } } }
I20260807 19:58:30.173511 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.168450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49182 (local address 127.5.197.129:36281)
0807 19:58:30.168667 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:30.168672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:30.168690 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:58:30.168882 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:30.168886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:30.168984 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:30.169107 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:58:30.169426 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.170138 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.171446 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.171899 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.171988 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.172513 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:58:30.173031 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:58:30.173137 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:30.173178 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 19:58:30.173240 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:58:30.181856 27433 raft_consensus.cc:1261] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Refusing update from remote peer a4616027b8884e6a8301e035c2d35202: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:30.181857 27221 raft_consensus.cc:1261] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 FOLLOWER]: Refusing update from remote peer a4616027b8884e6a8301e035c2d35202: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:30.182830 27561 consensus_queue.cc:1035] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:30.183225 27555 consensus_queue.cc:1035] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:30.197664 27564 mvcc.cc:205] Tried to move back new op lower bound from 7315999580894203904 to 7315999580533186560. Current Snapshot: MvccSnapshot[applied={T|T < 7315999580894203904}]
I20260807 19:58:30.212158 26775 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:30.212383 26775 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:30.215845 26775 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Sending DeleteTablet for 3 replicas of tablet 2f8c94cec2dd4dec94c9e7c9f19c0166
I20260807 19:58:30.217056 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:30 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:49170
I20260807 19:58:30.217262 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 26868
I20260807 19:58:30.217227 27399 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:30 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:43828
I20260807 19:58:30.217989 27196 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:30 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:60490
I20260807 19:58:30.229508 27583 tablet_replica.cc:330] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: stopping tablet replica
I20260807 19:58:30.229986 27583 raft_consensus.cc:2229] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:58:30.230687 27583 raft_consensus.cc:2258] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:30.233032 27583 ts_tablet_manager.cc:1905] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:30.240968 27583 ts_tablet_manager.cc:1918] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:30.241235 27583 log.cc:1196] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/2f8c94cec2dd4dec94c9e7c9f19c0166
I20260807 19:58:30.241897 27583 ts_tablet_manager.cc:1939] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P a4616027b8884e6a8301e035c2d35202: Deleting consensus metadata
I20260807 19:58:30.243892 26753 catalog_manager.cc:4841] TS a4616027b8884e6a8301e035c2d35202 (127.5.197.129:36281): tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 (table test-table [id=a45a6905a0004945b8b13146c43e7466]) successfully deleted
I20260807 19:58:30.247014 27586 tablet_replica.cc:330] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: stopping tablet replica
I20260807 19:58:30.247519 27586 raft_consensus.cc:2229] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:30.248072 27586 raft_consensus.cc:2258] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:30.248808 27584 tablet_replica.cc:330] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: stopping tablet replica
I20260807 19:58:30.249140 27584 raft_consensus.cc:2229] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:30.249521 27584 raft_consensus.cc:2258] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:30.251489 27586 ts_tablet_manager.cc:1905] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 19:58:30 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:58:30.256912 27586 ts_tablet_manager.cc:1918] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:30.257073 27586 log.cc:1196] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/2f8c94cec2dd4dec94c9e7c9f19c0166
I20260807 19:58:30.257601 27586 ts_tablet_manager.cc:1939] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P 19a85696bcd34fcb83430cdc2ff43cc1: Deleting consensus metadata
I20260807 19:58:30.258404 27584 ts_tablet_manager.cc:1905] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:30.259423 26751 catalog_manager.cc:4841] TS 19a85696bcd34fcb83430cdc2ff43cc1 (127.5.197.130:41291): tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 (table test-table [id=a45a6905a0004945b8b13146c43e7466]) successfully deleted
I20260807 19:58:30.263840 27584 ts_tablet_manager.cc:1918] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:30.263998 27584 log.cc:1196] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/2f8c94cec2dd4dec94c9e7c9f19c0166
I20260807 19:58:30.264281 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.219319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49192 (local address 127.5.197.129:36281)
0807 19:58:30.219496 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:30.219506 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:30.243420 (+ 23914us) server_negotiation.cc:407] Connection header received
0807 19:58:30.243959 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:30.243965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:30.244052 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:30.244134 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:30.246530 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.247912 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.250159 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.250937 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.251044 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.256775 (+ 5731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:30.256788 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:30.256805 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:30.256852 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:30.260877 (+ 4025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:30.261745 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:30.261755 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:30.261759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:30.261964 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:30.262516 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:30.262521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:30.262525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:30.262982 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:30.263343 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:30.263605 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 19:58:30.263894 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:58:30.264492 27584 ts_tablet_manager.cc:1939] T 2f8c94cec2dd4dec94c9e7c9f19c0166 P e80c979b07be45e5bd871a051947fb99: Deleting consensus metadata
I20260807 19:58:30.265136 27063 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:30.266250 26751 catalog_manager.cc:4841] TS e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321): tablet 2f8c94cec2dd4dec94c9e7c9f19c0166 (table test-table [id=a45a6905a0004945b8b13146c43e7466]) successfully deleted
I20260807 19:58:30.364233 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 26868
I20260807 19:58:30.391772 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 27077
Aug 07 19:58:30 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:58:30.406605 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.392672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60494 (local address 127.5.197.130:41291)
0807 19:58:30.392874 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:30.392880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:30.392900 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:58:30.393025 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:30.393029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:30.393095 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:30.393180 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:30.394510 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.395277 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.396706 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.397108 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.397218 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.401221 (+ 4003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:30.401236 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:30.401252 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:30.401290 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:30.403922 (+ 2632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:30.404568 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:30.404577 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:30.404579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:30.404718 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:30.405087 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:30.405091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:30.405093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:30.405488 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:30.405797 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:30.406072 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 19:58:30.406283 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:58:30.407187 27277 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:30.494326 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 27077
I20260807 19:58:30.516770 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 27294
Aug 07 19:58:30 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:58:30.531486 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:30.517508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43840 (local address 127.5.197.131:39321)
0807 19:58:30.517684 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:30.517689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:30.517710 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:58:30.517887 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:30.517891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:30.517967 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:30.518054 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:30.519379 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.520141 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.521451 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:30.521848 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:30.521956 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:30.526241 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:30.526258 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:30.526275 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:30.526311 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:30.528766 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:30.529433 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:30.529441 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:30.529443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:30.529586 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:30.529970 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:30.529974 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:30.529976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:30.530343 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:30.530635 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:30.530934 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 19:58:30.531139 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:58:30.532140 27505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:30.618207 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 27294
I20260807 19:58:30.641458 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 26726
I20260807 19:58:30.642597 26821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:30.753038 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 26726
I20260807 19:58:30.780916 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43119
--webserver_interface=127.5.197.190
--webserver_port=41373
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:43119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:31.112949 27594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:31.113225 27594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:31.113369 27594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:31.120258 27594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:31.120350 27594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:31.120422 27594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:31.120501 27594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:31.120563 27594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:31.129822 27594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:43119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=41373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:31.131011 27594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:31.132279 27594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:31.157169 27612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:31.157222 27611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:31.157197 27614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:31.158335 27594 server_base.cc:1034] running on GCE node
I20260807 19:58:31.159147 27594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:31.160682 27594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:31.161912 27594 hybrid_clock.cc:648] HybridClock initialized: now 1786132711161832 us; error 45 us; skew 500 ppm
I20260807 19:58:31.162293 27594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:31 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132711, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:31.169134 27594 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:31.170677 27594 webserver.cc:460] Webserver started at http://127.5.197.190:41373/ using document root <none> and password file <none>
I20260807 19:58:31.171428 27594 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:31.171567 27594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:31.177446 27594 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:58:31.180356 27622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:31.181648 27594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:31.181815 27594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "0e2cabc4fc5348f4afe932a1f249b079"
format_stamp: "Formatted at 2026-08-07 19:58:27 on dist-test-slave-6bbx"
server_key: "e47a1e730da2c9dc9525465e6b1dcd2b"
server_key_iv: "533c6b9203ae86fa055a9ab62a9ce8d6"
server_key_version: "encryptionkey@0"
I20260807 19:58:31.182895 27594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:31.208194 27594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:31.212037 27594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:31.212281 27594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:31.229755 27594 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:43119
I20260807 19:58:31.229774 27703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:43119 every 8 connection(s)
I20260807 19:58:31.231195 27594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:31.236465 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 27594
I20260807 19:58:31.237289 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:36281
--local_ip_for_outbound_sockets=127.5.197.129
--tserver_master_addrs=127.5.197.190:43119
--webserver_port=44297
--webserver_interface=127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:58:31.238508 27704 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:58:31.241927 27704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Bootstrap starting.
I20260807 19:58:31.265533 27704 log.cc:824] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:31.278260 27704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:58:31.278820 27704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Bootstrap complete.
I20260807 19:58:31.288421 27704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:31.289248 27704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2cabc4fc5348f4afe932a1f249b079, State: Initialized, Role: FOLLOWER
I20260807 19:58:31.289872 27704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:31.290110 27704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:58:31.290239 27704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:58:31.290405 27704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:58:31.294173 27704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:31.294699 27704 leader_election.cc:302] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e2cabc4fc5348f4afe932a1f249b079; no voters:
I20260807 19:58:31.295301 27704 leader_election.cc:288] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:58:31.295480 27708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:58:31.296494 27708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 LEADER]: Becoming Leader. State: Replica: 0e2cabc4fc5348f4afe932a1f249b079, State: Running, Role: LEADER
I20260807 19:58:31.297045 27708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:31.297408 27704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:31.299594 27709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0e2cabc4fc5348f4afe932a1f249b079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } } }
I20260807 19:58:31.300011 27709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:31.302343 27710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e2cabc4fc5348f4afe932a1f249b079. Latest consensus state: current_term: 2 leader_uuid: "0e2cabc4fc5348f4afe932a1f249b079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } } }
I20260807 19:58:31.302662 27710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:31.304266 27715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:31.312562 27715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:31.314038 27715 catalog_manager.cc:1259] Loaded cluster ID: 08d536d39eeb41a0a965b3d3ea28a3f5
I20260807 19:58:31.314136 27715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:58:31.317553 27715 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 19:58:31.332111 27729 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 19:58:31.334738 27715 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 19:58:31.341316 27715 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:58:31.342746 27715 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Loaded TSK: 0
I20260807 19:58:31.343870 27715 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 19:58:31.609396 27706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:31.609688 27706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:31.609833 27706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:31.616933 27706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:31.617033 27706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:31.617170 27706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:58:31.627143 27706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:36281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=44297
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:31.628422 27706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:31.629735 27706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:31.642810 27739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:31.642902 27741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:31.643537 27706 server_base.cc:1034] running on GCE node
W20260807 19:58:31.643628 27737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:31.644348 27706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:31.645278 27706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:31.646497 27706 hybrid_clock.cc:648] HybridClock initialized: now 1786132711646449 us; error 38 us; skew 500 ppm
I20260807 19:58:31.646819 27706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:31 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132711, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:31.649909 27706 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:58:31.651328 27706 webserver.cc:460] Webserver started at http://127.5.197.129:44297/ using document root <none> and password file <none>
I20260807 19:58:31.652041 27706 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:31.652175 27706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:31.657398 27706 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 19:58:31.660145 27752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:31.661600 27706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:58:31.661754 27706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "a4616027b8884e6a8301e035c2d35202"
format_stamp: "Formatted at 2026-08-07 19:58:28 on dist-test-slave-6bbx"
server_key: "2482f2a8265ee08c5f6521ec4de6b24b"
server_key_iv: "818de18450cb0f7f9b488fe9630f233e"
server_key_version: "encryptionkey@0"
I20260807 19:58:31.662772 27706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:31.674479 27706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:31.678289 27706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:31.678526 27706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:31.679451 27706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:31.680765 27706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:31.680869 27706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:31.680972 27706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:31.681041 27706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:31.710111 27706 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:36281
I20260807 19:58:31.710176 27918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:36281 every 8 connection(s)
I20260807 19:58:31.711546 27706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:58:31.712149 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 27706
I20260807 19:58:31.712872 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:41291
--local_ip_for_outbound_sockets=127.5.197.130
--tserver_master_addrs=127.5.197.190:43119
--webserver_port=39079
--webserver_interface=127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:58:31 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132711, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:31.735050 27922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:31.714493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:50747 (local address 127.5.197.190:43119)
0807 19:58:31.715142 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:31.715159 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:31.715731 (+ 572us) server_negotiation.cc:407] Connection header received
0807 19:58:31.718302 (+ 2571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:31.718314 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:31.718627 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:31.718916 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:31.720783 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:31.722000 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:31.724052 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:31.724675 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:31.724798 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:31.728191 (+ 3393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:31.728199 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:31.728211 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:31.728251 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:31.730851 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:31.731560 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:31.731566 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:31.731572 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:31.731772 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:31.732183 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:31.732187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:31.732189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:31.732618 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:31.732800 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:31.733539 (+ 739us) server_negotiation.cc:299] Negotiation successful
0807 19:58:31.733933 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":262,"threads_started":1}
I20260807 19:58:31.735050 27923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:31.714689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:50747)
0807 19:58:31.715527 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:31.715584 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:31.717779 (+ 2195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:31.719131 (+ 1352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:31.719142 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:31.719854 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:31.720578 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:31.720604 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:31.722184 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:31.722189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:31.723922 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:31.723938 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:31.724915 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:31.724921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:31.725175 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:31.725794 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:31.725818 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:31.727942 (+ 2124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:31.730997 (+ 3055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:31.731006 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:31.731019 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:31.731425 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:31.731880 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:31.731885 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:31.731889 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:31.732067 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:31.732761 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:31.732769 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:31.733065 (+ 296us) client_negotiation.cc:769] Sending connection context
0807 19:58:31.733289 (+ 224us) client_negotiation.cc:240] Negotiation successful
0807 19:58:31.733800 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":325,"threads_started":1}
I20260807 19:58:31.737723 27919 heartbeater.cc:347] Connected to a master server at 127.5.197.190:43119
I20260807 19:58:31.738003 27919 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:31.738667 27919 heartbeater.cc:511] Master 127.5.197.190:43119 requested a full tablet report, sending...
I20260807 19:58:31.740700 27646 ts_manager.cc:194] Registered new tserver with Master: a4616027b8884e6a8301e035c2d35202 (127.5.197.129:36281)
I20260807 19:58:31.742239 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:50747
W20260807 19:58:32.047839 27925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:32.048117 27925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:32.048250 27925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:32.055296 27925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:32.055410 27925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:32.055565 27925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:58:32.065062 27925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:41291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=39079
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:32.066296 27925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:32.067610 27925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:32.080565 27931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:32.080595 27933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:32.080874 27938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:32.081203 27925 server_base.cc:1034] running on GCE node
I20260807 19:58:32.081789 27925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:32.082651 27925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:32.083843 27925 hybrid_clock.cc:648] HybridClock initialized: now 1786132712083789 us; error 48 us; skew 500 ppm
I20260807 19:58:32.084136 27925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:32 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132712, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:32.087117 27925 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:58:32.088461 27925 webserver.cc:460] Webserver started at http://127.5.197.130:39079/ using document root <none> and password file <none>
I20260807 19:58:32.089105 27925 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:32.089232 27925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:32.094316 27925 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 19:58:32.096925 27949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:32.098246 27925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:32.098419 27925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "19a85696bcd34fcb83430cdc2ff43cc1"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "a64a1adf1552fa2de0e9758dcd2c9ddb"
server_key_iv: "c4e5823e8a22769acfd4d3d1576c94dd"
server_key_version: "encryptionkey@0"
I20260807 19:58:32.099702 27925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:32.124243 27925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:32.128927 27925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:32.129153 27925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:32.130090 27925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:32.131377 27925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:32.131496 27925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:32.131579 27925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:32.131634 27925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:32.161162 27925 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41291
I20260807 19:58:32.161232 28116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41291 every 8 connection(s)
I20260807 19:58:32.162664 27925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:58:32.167917 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 27925
I20260807 19:58:32.168541 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:39321
--local_ip_for_outbound_sockets=127.5.197.131
--tserver_master_addrs=127.5.197.190:43119
--webserver_port=38189
--webserver_interface=127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:58:32 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132712, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:32.182814 27922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.165093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:44923 (local address 127.5.197.190:43119)
0807 19:58:32.165307 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:32.165314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:32.166509 (+ 1195us) server_negotiation.cc:407] Connection header received
0807 19:58:32.168424 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:32.168430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:32.168518 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:32.168638 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:32.170106 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.171031 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.172595 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.173199 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.173323 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.176595 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:32.176601 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:32.176605 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:32.176646 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:32.179627 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:32.180712 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:32.180717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:32.180719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:32.180845 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:32.181283 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:32.181286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:32.181288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:32.181540 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:32.181650 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:32.182396 (+ 746us) server_negotiation.cc:299] Negotiation successful
0807 19:58:32.182574 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:58:32.183872 28119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.165581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:44923)
0807 19:58:32.166337 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:32.166379 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:32.168154 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:32.168873 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:32.168881 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:32.169388 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:32.169933 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.169951 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.171176 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.171180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.172451 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.172464 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.173403 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.173408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.173597 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.174223 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:32.174245 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:32.176392 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:32.180022 (+ 3630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:32.180029 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:32.180041 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:32.180584 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:32.180949 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:32.180954 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:32.180957 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:32.181192 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:32.181659 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:32.181667 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:32.182045 (+ 378us) client_negotiation.cc:769] Sending connection context
0807 19:58:32.182307 (+ 262us) client_negotiation.cc:240] Negotiation successful
0807 19:58:32.182696 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":279,"threads_started":1}
I20260807 19:58:32.185370 28117 heartbeater.cc:347] Connected to a master server at 127.5.197.190:43119
I20260807 19:58:32.185659 28117 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:32.186417 28117 heartbeater.cc:511] Master 127.5.197.190:43119 requested a full tablet report, sending...
I20260807 19:58:32.187935 27646 ts_manager.cc:194] Registered new tserver with Master: 19a85696bcd34fcb83430cdc2ff43cc1 (127.5.197.130:41291)
I20260807 19:58:32.189004 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:44923
W20260807 19:58:32.501663 28120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:32.501931 28120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:32.502032 28120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:32.509155 28120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:32.509258 28120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:32.509380 28120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:58:32.518647 28120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:39321
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=38189
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:32.519850 28120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:32.521088 28120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:32.533725 28125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:32.533766 28126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:32.533789 28129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:32.534706 28120 server_base.cc:1034] running on GCE node
I20260807 19:58:32.535243 28120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:32.536139 28120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:32.537340 28120 hybrid_clock.cc:648] HybridClock initialized: now 1786132712537289 us; error 33 us; skew 500 ppm
I20260807 19:58:32.537628 28120 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:32 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132712, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:32.540606 28120 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:58:32.541988 28120 webserver.cc:460] Webserver started at http://127.5.197.131:38189/ using document root <none> and password file <none>
I20260807 19:58:32.542654 28120 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:32.542780 28120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:32.548547 28120 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:58:32.551108 28137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:32.552448 28120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:58:32.552597 28120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "e80c979b07be45e5bd871a051947fb99"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "b1a0d03c3ed9831a6b9e352d72bdb6d7"
server_key_iv: "2082ea5b0a33be2c5ca5c7d1990ec21a"
server_key_version: "encryptionkey@0"
I20260807 19:58:32.553521 28120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:32.570924 28120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:32.574503 28120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:32.574738 28120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:32.575645 28120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:32.576918 28120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:32.577015 28120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:32.577123 28120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:32.577203 28120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:32.607614 28120 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39321
I20260807 19:58:32.607689 28310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39321 every 8 connection(s)
I20260807 19:58:32.609040 28120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:58:32.619401 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 28120
Aug 07 19:58:32 dist-test-slave-6bbx krb5kdc[26710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132712, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:32.627931 27922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.611385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:41087 (local address 127.5.197.190:43119)
0807 19:58:32.611608 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:32.611614 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:32.612735 (+ 1121us) server_negotiation.cc:407] Connection header received
0807 19:58:32.614466 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:32.614470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:32.614535 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:32.614620 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:32.616049 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.616765 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.618178 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.618577 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.618663 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.622329 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:32.622335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:32.622340 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:32.622380 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:32.625105 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:32.625776 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:32.625782 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:32.625785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:32.625919 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:32.626328 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:32.626331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:32.626333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:32.626590 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:32.626722 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:32.627386 (+ 664us) server_negotiation.cc:299] Negotiation successful
0807 19:58:32.627596 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:58:32.629076 28313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.611874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:41087)
0807 19:58:32.612571 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:32.612609 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:32.614218 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:32.614811 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:32.614818 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:32.615325 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:32.615907 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.615927 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.616889 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.616893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.618072 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.618084 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.618766 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.618771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.619007 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.619755 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:32.619784 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:32.622101 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:32.625238 (+ 3137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:32.625247 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:32.625263 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:32.625648 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:32.626024 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:32.626029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:32.626033 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:32.626206 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:32.626713 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:32.626720 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:32.627026 (+ 306us) client_negotiation.cc:769] Sending connection context
0807 19:58:32.627251 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 19:58:32.627739 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":260,"threads_started":1}
I20260807 19:58:32.630542 28311 heartbeater.cc:347] Connected to a master server at 127.5.197.190:43119
I20260807 19:58:32.630826 28311 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:32.631641 28311 heartbeater.cc:511] Master 127.5.197.190:43119 requested a full tablet report, sending...
I20260807 19:58:32.633339 27646 ts_manager.cc:194] Registered new tserver with Master: e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321)
I20260807 19:58:32.633960 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.620384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49884 (local address 127.5.197.190:43119)
0807 19:58:32.620861 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:32.620867 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:32.621178 (+ 311us) server_negotiation.cc:407] Connection header received
0807 19:58:32.621333 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:32.621337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:32.621396 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:32.621480 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:32.623145 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.624005 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.625295 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.625696 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.625800 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.628287 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:32.628293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:32.628297 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:32.628331 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:32.631185 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:32.632011 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:32.632015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:32.632017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:32.632128 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:32.632508 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:32.632512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:32.632515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:32.632837 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:32.633074 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:32.633400 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 19:58:32.633603 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":228,"threads_started":1}
I20260807 19:58:32.634332 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:41087
I20260807 19:58:32.636354 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:58:32.642706 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.637186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49896 (local address 127.5.197.190:43119)
0807 19:58:32.637341 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:32.637345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:32.637838 (+ 493us) server_negotiation.cc:407] Connection header received
0807 19:58:32.638053 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:32.638057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:32.638178 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:32.638296 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:58:32.638700 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.639367 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.640815 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.641198 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.641302 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.641742 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:58:32.642184 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:58:32.642307 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:32.642428 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 19:58:32.642501 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 19:58:32.643487 27646 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:49896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:58:32.650426 27646 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:58:32.682921 28326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.661219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49202 (local address 127.5.197.129:36281)
0807 19:58:32.674599 (+ 13380us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:32.674608 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:32.674637 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:58:32.674738 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:32.674746 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:32.674994 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:32.675174 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:32.676052 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.677571 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.680042 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.681672 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.681826 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.682013 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:32.682410 (+ 397us) server_negotiation.cc:299] Negotiation successful
0807 19:58:32.682582 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13229,"thread_start_us":13090,"threads_started":1}
I20260807 19:58:32.682945 28327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.661174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:36281 (local address 127.0.0.1:49202)
0807 19:58:32.673179 (+ 12005us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:32.673224 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:32.673421 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:32.675216 (+ 1795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:32.675225 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:32.675262 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:32.675809 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.675825 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.677745 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.677750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.679853 (+ 2103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.679881 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.681925 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.681933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.682131 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.682201 (+ 70us) client_negotiation.cc:769] Sending connection context
0807 19:58:32.682338 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 19:58:32.682530 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11715,"mutex_wait_us":25,"thread_start_us":12438,"threads_started":1}
I20260807 19:58:32.683449 28328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.661394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39321 (local address 127.0.0.1:43842)
0807 19:58:32.675334 (+ 13940us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:32.675360 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:32.675489 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:32.676817 (+ 1328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:32.676823 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:32.676850 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:32.677214 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.677225 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.679420 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.679426 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.681167 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.681180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.682719 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.682726 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.682890 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.682922 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:58:32.682994 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 19:58:32.683109 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13815,"mutex_wait_us":1,"thread_start_us":13661,"threads_started":1}
I20260807 19:58:32.684940 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.675734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41291 (local address 127.0.0.1:60496)
0807 19:58:32.676814 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:32.676830 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:32.677039 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:32.677592 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:32.677596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:32.677621 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:32.678180 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.678199 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.679886 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.679890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.682168 (+ 2278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:32.682181 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.684244 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.684252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:32.684431 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.684463 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:58:32.684558 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 19:58:32.684678 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":962,"mutex_wait_us":26,"spinlock_wait_cycles":3456,"thread_start_us":836,"threads_started":1}
I20260807 19:58:32.685093 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.675769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60496 (local address 127.5.197.130:41291)
0807 19:58:32.676413 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:32.676422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:32.676919 (+ 497us) server_negotiation.cc:407] Connection header received
0807 19:58:32.677220 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:32.677227 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:32.677410 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:32.677590 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:32.678432 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.679733 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.682330 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.683740 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.683864 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.684075 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:32.684651 (+ 576us) server_negotiation.cc:299] Negotiation successful
0807 19:58:32.684806 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":316,"threads_started":1}
I20260807 19:58:32.686686 27826 tablet_service.cc:1467] Processing CreateTablet for tablet 52b94fa976a54c13962ed677a7c498f0 (DEFAULT_TABLE table=test-table [id=b1f7c58fba5c4873bb5eee49e5af5598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:32.688015 27826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52b94fa976a54c13962ed677a7c498f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:32.688098 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:32.661960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43842 (local address 127.5.197.131:39321)
0807 19:58:32.674979 (+ 13019us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:32.674986 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:32.675471 (+ 485us) server_negotiation.cc:407] Connection header received
0807 19:58:32.676438 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:32.676447 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:32.676648 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:32.676821 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:32.677371 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.679259 (+ 1888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.681322 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:32.682484 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:32.687453 (+ 4969us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:32.687634 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:32.687732 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 19:58:32.687873 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12856,"thread_start_us":12702,"threads_started":1}
I20260807 19:58:32.690382 28022 tablet_service.cc:1467] Processing CreateTablet for tablet 52b94fa976a54c13962ed677a7c498f0 (DEFAULT_TABLE table=test-table [id=b1f7c58fba5c4873bb5eee49e5af5598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:32.691702 28022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52b94fa976a54c13962ed677a7c498f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:32.691440 28209 tablet_service.cc:1467] Processing CreateTablet for tablet 52b94fa976a54c13962ed677a7c498f0 (DEFAULT_TABLE table=test-table [id=b1f7c58fba5c4873bb5eee49e5af5598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:32.692732 28209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52b94fa976a54c13962ed677a7c498f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:32.702740 28333 tablet_bootstrap.cc:492] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Bootstrap starting.
I20260807 19:58:32.705938 28333 tablet_bootstrap.cc:654] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:32.706889 28333 log.cc:824] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:32.707757 28337 tablet_bootstrap.cc:492] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Bootstrap starting.
I20260807 19:58:32.709087 28334 tablet_bootstrap.cc:492] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Bootstrap starting.
I20260807 19:58:32.711529 28337 tablet_bootstrap.cc:654] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:32.712455 28334 tablet_bootstrap.cc:654] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:32.712997 28337 log.cc:824] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:32.713567 28334 log.cc:824] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:32.716466 28337 tablet_bootstrap.cc:492] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: No bootstrap required, opened a new log
I20260807 19:58:32.716464 28333 tablet_bootstrap.cc:492] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: No bootstrap required, opened a new log
I20260807 19:58:32.716744 28337 ts_tablet_manager.cc:1397] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 19:58:32.716761 28333 ts_tablet_manager.cc:1397] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260807 19:58:32.727217 28334 tablet_bootstrap.cc:492] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: No bootstrap required, opened a new log
I20260807 19:58:32.727062 28333 raft_consensus.cc:348] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:32.727520 28334 ts_tablet_manager.cc:1397] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.016s
I20260807 19:58:32.727519 28333 raft_consensus.cc:374] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:32.727622 28333 raft_consensus.cc:729] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a85696bcd34fcb83430cdc2ff43cc1, State: Initialized, Role: FOLLOWER
I20260807 19:58:32.728433 28333 consensus_queue.cc:260] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:32.728441 28337 raft_consensus.cc:348] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:32.728832 28337 raft_consensus.cc:374] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:32.728943 28337 raft_consensus.cc:729] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80c979b07be45e5bd871a051947fb99, State: Initialized, Role: FOLLOWER
I20260807 19:58:32.729589 28337 consensus_queue.cc:260] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:32.730720 28311 heartbeater.cc:503] Master 127.5.197.190:43119 was elected leader, sending a full tablet report...
I20260807 19:58:32.732843 28337 ts_tablet_manager.cc:1428] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260807 19:58:32.733754 28117 heartbeater.cc:503] Master 127.5.197.190:43119 was elected leader, sending a full tablet report...
I20260807 19:58:32.735504 28333 ts_tablet_manager.cc:1428] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Time spent starting tablet: real 0.019s user 0.017s sys 0.000s
I20260807 19:58:32.737046 28334 raft_consensus.cc:348] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:32.737485 28334 raft_consensus.cc:374] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:32.737592 28334 raft_consensus.cc:729] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4616027b8884e6a8301e035c2d35202, State: Initialized, Role: FOLLOWER
I20260807 19:58:32.738145 28334 consensus_queue.cc:260] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:32.739117 27919 heartbeater.cc:503] Master 127.5.197.190:43119 was elected leader, sending a full tablet report...
I20260807 19:58:32.740360 28334 ts_tablet_manager.cc:1428] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
W20260807 19:58:32.860532 28312 tablet.cc:2369] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:58:32.914701 28118 tablet.cc:2369] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:58:32.963963 27921 tablet.cc:2369] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:58:33.027225 28342 raft_consensus.cc:482] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:58:33.027591 28342 raft_consensus.cc:504] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:33.029251 28342 leader_election.cc:288] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4616027b8884e6a8301e035c2d35202 (127.5.197.129:36281), e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321)
I20260807 19:58:33.036141 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.029735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:34375 (local address 127.5.197.131:39321)
0807 19:58:33.029957 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:33.029964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:33.030849 (+ 885us) server_negotiation.cc:407] Connection header received
0807 19:58:33.031015 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:33.031018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:33.031082 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:33.031168 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:33.031752 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.032504 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.034405 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.035164 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.035316 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.035389 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:33.035755 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 19:58:33.035894 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:58:33.036142 28326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.029712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:45707 (local address 127.5.197.129:36281)
0807 19:58:33.029949 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:33.029956 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:33.030719 (+ 763us) server_negotiation.cc:407] Connection header received
0807 19:58:33.030931 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:33.030936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:33.031017 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:33.031084 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:33.031860 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.032548 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.034411 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.035162 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.035297 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.035379 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:33.035727 (+ 348us) server_negotiation.cc:299] Negotiation successful
0807 19:58:33.035862 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:58:33.036329 28346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.029719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:36281 (local address 127.5.197.130:45707)
0807 19:58:33.030604 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:33.030621 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:33.030769 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:33.031122 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:33.031126 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:33.031151 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:33.031716 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:33.031730 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.032683 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.032691 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:33.034243 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:33.034256 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.035401 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.035409 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:33.035559 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.035595 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:58:33.035690 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 19:58:33.035823 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":48,"spinlock_wait_cycles":40064,"thread_start_us":506,"threads_started":1}
I20260807 19:58:33.036645 28347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.030020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39321 (local address 127.5.197.130:34375)
0807 19:58:33.030754 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:33.030768 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:33.030898 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:33.031203 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:33.031211 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:33.031235 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:33.031586 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:33.031596 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.032633 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.032638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:33.034253 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:33.034265 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.035442 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.035447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:33.035587 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.035610 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 19:58:33.035716 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 19:58:33.035868 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":78,"thread_start_us":411,"threads_started":1}
I20260807 19:58:33.037352 27857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b94fa976a54c13962ed677a7c498f0" candidate_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4616027b8884e6a8301e035c2d35202" is_pre_election: true
I20260807 19:58:33.037506 28243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b94fa976a54c13962ed677a7c498f0" candidate_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80c979b07be45e5bd871a051947fb99" is_pre_election: true
I20260807 19:58:33.037995 28243 raft_consensus.cc:2454] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a85696bcd34fcb83430cdc2ff43cc1 in term 0.
I20260807 19:58:33.037997 27857 raft_consensus.cc:2454] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a85696bcd34fcb83430cdc2ff43cc1 in term 0.
I20260807 19:58:33.038691 27961 leader_election.cc:302] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a85696bcd34fcb83430cdc2ff43cc1, e80c979b07be45e5bd871a051947fb99; no voters:
I20260807 19:58:33.039140 28342 raft_consensus.cc:2781] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:58:33.039337 28342 raft_consensus.cc:482] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:58:33.039436 28342 raft_consensus.cc:3037] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:33.041631 28342 raft_consensus.cc:504] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:33.042194 28342 leader_election.cc:288] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [CANDIDATE]: Term 1 election: Requested vote from peers a4616027b8884e6a8301e035c2d35202 (127.5.197.129:36281), e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321)
I20260807 19:58:33.042605 27857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b94fa976a54c13962ed677a7c498f0" candidate_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4616027b8884e6a8301e035c2d35202"
I20260807 19:58:33.042667 28243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52b94fa976a54c13962ed677a7c498f0" candidate_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80c979b07be45e5bd871a051947fb99"
I20260807 19:58:33.042829 28243 raft_consensus.cc:3037] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:33.042819 27857 raft_consensus.cc:3037] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:33.045931 28243 raft_consensus.cc:2454] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a85696bcd34fcb83430cdc2ff43cc1 in term 1.
I20260807 19:58:33.045931 27857 raft_consensus.cc:2454] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a85696bcd34fcb83430cdc2ff43cc1 in term 1.
I20260807 19:58:33.046324 27962 leader_election.cc:302] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a85696bcd34fcb83430cdc2ff43cc1, a4616027b8884e6a8301e035c2d35202; no voters:
I20260807 19:58:33.046629 28342 raft_consensus.cc:2781] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:33.047048 28342 raft_consensus.cc:686] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 LEADER]: Becoming Leader. State: Replica: 19a85696bcd34fcb83430cdc2ff43cc1, State: Running, Role: LEADER
I20260807 19:58:33.047495 28342 consensus_queue.cc:237] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } }
I20260807 19:58:33.051795 27645 catalog_manager.cc:5495] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19a85696bcd34fcb83430cdc2ff43cc1 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19a85696bcd34fcb83430cdc2ff43cc1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41291 } health_report { overall_health: HEALTHY } } }
I20260807 19:58:33.123178 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.118217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.5.197.130:41291)
0807 19:58:33.118516 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:33.118520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:33.118538 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:58:33.118630 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:33.118634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:33.118716 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:33.118838 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:58:33.119109 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.119828 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.121277 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.121678 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.121763 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.122180 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:58:33.122684 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:58:33.122784 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:33.122857 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 19:58:33.122922 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
I20260807 19:58:33.131268 28243 raft_consensus.cc:1261] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Refusing update from remote peer 19a85696bcd34fcb83430cdc2ff43cc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:33.131271 27857 raft_consensus.cc:1261] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 1 FOLLOWER]: Refusing update from remote peer 19a85696bcd34fcb83430cdc2ff43cc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:33.132176 28342 consensus_queue.cc:1035] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4616027b8884e6a8301e035c2d35202" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:33.132453 28348 consensus_queue.cc:1035] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80c979b07be45e5bd871a051947fb99" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:33.141443 28353 mvcc.cc:205] Tried to move back new op lower bound from 7315999592975958016 to 7315999592646131712. Current Snapshot: MvccSnapshot[applied={T|T < 7315999592975958016}]
I20260807 19:58:33.148352 28355 mvcc.cc:205] Tried to move back new op lower bound from 7315999592975958016 to 7315999592646131712. Current Snapshot: MvccSnapshot[applied={T|T < 7315999592975958016 or (T in {7315999592975958016})}]
I20260807 19:58:33.150552 28358 mvcc.cc:205] Tried to move back new op lower bound from 7315999592975958016 to 7315999592646131712. Current Snapshot: MvccSnapshot[applied={T|T < 7315999592975958016}]
I20260807 19:58:33.155603 27646 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:49896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:33.155923 27646 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:49896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:33.159520 27646 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Sending DeleteTablet for 3 replicas of tablet 52b94fa976a54c13962ed677a7c498f0
I20260807 19:58:33.160804 27826 tablet_service.cc:1514] Processing DeleteTablet for tablet 52b94fa976a54c13962ed677a7c498f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:33 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:49202
I20260807 19:58:33.161669 28365 tablet_replica.cc:330] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: stopping tablet replica
I20260807 19:58:33.161978 28209 tablet_service.cc:1514] Processing DeleteTablet for tablet 52b94fa976a54c13962ed677a7c498f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:33 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:43842
I20260807 19:58:33.162030 28365 raft_consensus.cc:2229] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:33.162565 28365 raft_consensus.cc:2258] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:33.163098 28022 tablet_service.cc:1514] Processing DeleteTablet for tablet 52b94fa976a54c13962ed677a7c498f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:33 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:60496
I20260807 19:58:33.163368 28366 tablet_replica.cc:330] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: stopping tablet replica
I20260807 19:58:33.163789 28366 raft_consensus.cc:2229] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:33.164201 28366 raft_consensus.cc:2258] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:33.164265 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 27706
I20260807 19:58:33.169564 28365 ts_tablet_manager.cc:1905] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:33.170993 28366 ts_tablet_manager.cc:1905] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:33.172092 28367 tablet_replica.cc:330] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: stopping tablet replica
I20260807 19:58:33.172490 28367 raft_consensus.cc:2229] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:58:33.173171 28367 raft_consensus.cc:2258] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:33.180052 28366 ts_tablet_manager.cc:1918] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:33.181653 28367 ts_tablet_manager.cc:1905] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:33.184155 28366 log.cc:1196] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/52b94fa976a54c13962ed677a7c498f0
I20260807 19:58:33.184719 28366 ts_tablet_manager.cc:1939] T 52b94fa976a54c13962ed677a7c498f0 P e80c979b07be45e5bd871a051947fb99: Deleting consensus metadata
I20260807 19:58:33.186604 27628 catalog_manager.cc:4841] TS e80c979b07be45e5bd871a051947fb99 (127.5.197.131:39321): tablet 52b94fa976a54c13962ed677a7c498f0 (table test-table [id=b1f7c58fba5c4873bb5eee49e5af5598]) successfully deleted
I20260807 19:58:33.186992 28365 ts_tablet_manager.cc:1918] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:33.187239 28365 log.cc:1196] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/52b94fa976a54c13962ed677a7c498f0
I20260807 19:58:33.187968 28365 ts_tablet_manager.cc:1939] T 52b94fa976a54c13962ed677a7c498f0 P a4616027b8884e6a8301e035c2d35202: Deleting consensus metadata
I20260807 19:58:33.189474 28367 ts_tablet_manager.cc:1918] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:33.189657 28367 log.cc:1196] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/52b94fa976a54c13962ed677a7c498f0
I20260807 19:58:33.189812 27630 catalog_manager.cc:4841] TS a4616027b8884e6a8301e035c2d35202 (127.5.197.129:36281): tablet 52b94fa976a54c13962ed677a7c498f0 (table test-table [id=b1f7c58fba5c4873bb5eee49e5af5598]) successfully deleted
I20260807 19:58:33.190228 28367 ts_tablet_manager.cc:1939] T 52b94fa976a54c13962ed677a7c498f0 P 19a85696bcd34fcb83430cdc2ff43cc1: Deleting consensus metadata
I20260807 19:58:33.191993 27628 catalog_manager.cc:4841] TS 19a85696bcd34fcb83430cdc2ff43cc1 (127.5.197.130:41291): tablet 52b94fa976a54c13962ed677a7c498f0 (table test-table [id=b1f7c58fba5c4873bb5eee49e5af5598]) successfully deleted
I20260807 19:58:33.211265 28326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.165160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49214 (local address 127.5.197.129:36281)
0807 19:58:33.165345 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:33.165352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:33.194598 (+ 29246us) server_negotiation.cc:407] Connection header received
0807 19:58:33.194775 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:33.194781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:33.194890 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:33.194997 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:33.196826 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.197943 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.200126 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.200726 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.200867 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.204313 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:33.204329 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:33.204369 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:33.204410 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:33.208123 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:33.208973 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:33.208983 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:33.208987 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:33.209156 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:33.209539 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:33.209545 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:33.209548 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:33.210036 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:33.210330 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:33.210668 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 19:58:33.210914 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:58:33.211997 27913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:33.313656 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 27706
I20260807 19:58:33.348023 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 27925
I20260807 19:58:33.363607 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.348804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60514 (local address 127.5.197.130:41291)
0807 19:58:33.349013 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:33.349019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:33.349040 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:58:33.349134 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:33.349139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:33.349232 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:33.349347 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:33.350691 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.351926 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.353197 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.353904 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.354030 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.356915 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:33.356930 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:33.356949 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:33.357000 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:33.360840 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:33.361522 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:33.361530 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:33.361533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:33.361717 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:33.362060 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:33.362066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:33.362069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:33.362567 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:33.362874 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:33.363031 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 19:58:33.363243 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 19:58:33.364464 28105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:33.475083 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 27925
I20260807 19:58:33.498543 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 28120
I20260807 19:58:33.511451 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:33.499376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43846 (local address 127.5.197.131:39321)
0807 19:58:33.499556 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:33.499561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:33.499579 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:58:33.499804 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:33.499808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:33.499878 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:33.499961 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:33.501216 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.501950 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.503195 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:33.503590 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:33.503714 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:33.506253 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:33.506266 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:33.506282 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:33.506315 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:33.509135 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:33.509768 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:33.509775 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:33.509777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:33.509906 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:33.510192 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:33.510194 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:33.510196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:33.510543 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:33.510748 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:33.510964 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 19:58:33.511118 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:58:33.512125 28305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:33.598152 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 28120
I20260807 19:58:33.621060 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 27594
I20260807 19:58:33.622200 27697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:33.735230 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 27594
I20260807 19:58:33.763918 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43119
--webserver_interface=127.5.197.190
--webserver_port=41373
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:43119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:34.089368 28380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:34.089629 28380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:34.089715 28380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:34.096668 28380 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:34.096764 28380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:34.096814 28380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:34.096869 28380 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:34.096911 28380 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:34.107298 28380 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:43119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=41373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:34.108613 28380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:34.109933 28380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:34.120875 28388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:34.121044 28385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:34.121080 28386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:34.121889 28380 server_base.cc:1034] running on GCE node
I20260807 19:58:34.122642 28380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:34.123956 28380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:34.125151 28380 hybrid_clock.cc:648] HybridClock initialized: now 1786132714125105 us; error 32 us; skew 500 ppm
I20260807 19:58:34.125486 28380 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:34 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132714, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:34.128479 28380 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:34.129812 28380 webserver.cc:460] Webserver started at http://127.5.197.190:41373/ using document root <none> and password file <none>
I20260807 19:58:34.130467 28380 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:34.130587 28380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:34.136059 28380 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:34.138696 28398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:34.140053 28380 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:34.140267 28380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "0e2cabc4fc5348f4afe932a1f249b079"
format_stamp: "Formatted at 2026-08-07 19:58:27 on dist-test-slave-6bbx"
server_key: "e47a1e730da2c9dc9525465e6b1dcd2b"
server_key_iv: "533c6b9203ae86fa055a9ab62a9ce8d6"
server_key_version: "encryptionkey@0"
I20260807 19:58:34.141256 28380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:34.174206 28380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:34.178465 28380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:34.178719 28380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:34.195962 28380 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:43119
I20260807 19:58:34.195983 28481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:43119 every 8 connection(s)
I20260807 19:58:34.197515 28380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:34.199198 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 28380
I20260807 19:58:34.200052 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:36281
--local_ip_for_outbound_sockets=127.5.197.129
--tserver_master_addrs=127.5.197.190:43119
--webserver_port=44297
--webserver_interface=127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:58:34.204466 28482 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:58:34.207630 28482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Bootstrap starting.
I20260807 19:58:34.232551 28482 log.cc:824] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:34.254169 28482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:58:34.254834 28482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079: Bootstrap complete.
I20260807 19:58:34.268129 28482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:34.269385 28482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2cabc4fc5348f4afe932a1f249b079, State: Initialized, Role: FOLLOWER
I20260807 19:58:34.270095 28482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:34.270387 28482 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:58:34.270509 28482 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:58:34.270689 28482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 2 FOLLOWER]: Advancing to term 3
I20260807 19:58:34.278546 28482 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:34.279141 28482 leader_election.cc:302] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e2cabc4fc5348f4afe932a1f249b079; no voters:
I20260807 19:58:34.279860 28482 leader_election.cc:288] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 19:58:34.279994 28488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 19:58:34.280993 28488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [term 3 LEADER]: Becoming Leader. State: Replica: 0e2cabc4fc5348f4afe932a1f249b079, State: Running, Role: LEADER
I20260807 19:58:34.281503 28488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } }
I20260807 19:58:34.281966 28482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:34.283819 28490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0e2cabc4fc5348f4afe932a1f249b079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } } }
I20260807 19:58:34.284178 28490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:34.284677 28491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e2cabc4fc5348f4afe932a1f249b079. Latest consensus state: current_term: 3 leader_uuid: "0e2cabc4fc5348f4afe932a1f249b079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2cabc4fc5348f4afe932a1f249b079" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43119 } } }
I20260807 19:58:34.284952 28491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2cabc4fc5348f4afe932a1f249b079 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:34.287068 28495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:34.299688 28495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:34.301335 28495 catalog_manager.cc:1259] Loaded cluster ID: 08d536d39eeb41a0a965b3d3ea28a3f5
I20260807 19:58:34.301474 28495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 19:58:34.303730 28495 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8b5b4f29ad google::LogMessage::Fail() at ??:0
@ 0x7f8b5b4f588a google::LogMessage::SendToLog() at ??:0
@ 0x7f8b5b4f24de google::LogMessage::Flush() at ??:0
@ 0x7f8b5b4f3a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8b70f25512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f8b70f22976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8b70faa610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f8b70faa439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260807 19:58:34.339073 28510 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f8b5e13e345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8b5e14191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f8b5e141799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8b5e11ceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8b613f66db start_thread at ??:0
@ 0x7f8b5a38c61f clone at ??:0
W20260807 19:58:34.659096 28485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:34.659371 28485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:34.659473 28485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:34.666531 28485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:34.666628 28485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:34.666744 28485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:58:34.676074 28485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:36281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=44297
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:34.677227 28485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:34.678458 28485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:34.690886 28538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:34.691435 28541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:34.691860 28544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:34.692324 28485 server_base.cc:1034] running on GCE node
I20260807 19:58:34.692931 28485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:34.693812 28485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:34.695027 28485 hybrid_clock.cc:648] HybridClock initialized: now 1786132714694978 us; error 31 us; skew 500 ppm
I20260807 19:58:34.695339 28485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:34 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132714, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:34.698535 28485 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:58:34.699906 28485 webserver.cc:460] Webserver started at http://127.5.197.129:44297/ using document root <none> and password file <none>
I20260807 19:58:34.700559 28485 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:34.700677 28485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:34.705837 28485 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 19:58:34.708468 28556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:34.709689 28485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:58:34.709848 28485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "a4616027b8884e6a8301e035c2d35202"
format_stamp: "Formatted at 2026-08-07 19:58:28 on dist-test-slave-6bbx"
server_key: "2482f2a8265ee08c5f6521ec4de6b24b"
server_key_iv: "818de18450cb0f7f9b488fe9630f233e"
server_key_version: "encryptionkey@0"
I20260807 19:58:34.710779 28485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:34.726818 28485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:34.730829 28485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:34.731079 28485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:34.732038 28485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:34.733309 28485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:34.733417 28485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:34.733516 28485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:34.733590 28485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:34.764582 28485 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:36281
I20260807 19:58:34.764650 28726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:36281 every 8 connection(s)
I20260807 19:58:34.765985 28485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:58:34.768826 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 28485
I20260807 19:58:34.769629 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:41291
--local_ip_for_outbound_sockets=127.5.197.130
--tserver_master_addrs=127.5.197.190:43119
--webserver_port=39079
--webserver_interface=127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:58:34.771027 28729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:34.769059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:60899)
0807 19:58:34.769928 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:34.770169 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":338,"threads_started":1}
W20260807 19:58:34.771823 28727 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:43119 (0 consecutive failures): Network error: Failed to ping master at 127.5.197.190:43119: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
I20260807 19:58:34.772635 28729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:34.772308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:48469)
0807 19:58:34.772459 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:34.772530 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 19:58:34.773473 28729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:34.773168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:43655)
0807 19:58:34.773290 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:34.773362 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 19:58:34.773703 28727 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:58:35.104620 28732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:35.104895 28732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:35.105000 28732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:35.113194 28732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:35.113327 28732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:35.113490 28732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:58:35.123145 28732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:41291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=39079
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:35.124480 28732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:35.125773 28732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:35.138300 28740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:35.138245 28747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:35.138330 28741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:35.139075 28732 server_base.cc:1034] running on GCE node
I20260807 19:58:35.139618 28732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:35.140534 28732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:35.141741 28732 hybrid_clock.cc:648] HybridClock initialized: now 1786132715141699 us; error 30 us; skew 500 ppm
I20260807 19:58:35.142012 28732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:35 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132715, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:35.145097 28732 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:58:35.146437 28732 webserver.cc:460] Webserver started at http://127.5.197.130:39079/ using document root <none> and password file <none>
I20260807 19:58:35.147082 28732 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:35.147193 28732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:35.152392 28732 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:58:35.155011 28755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:35.156350 28732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:35.156512 28732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "19a85696bcd34fcb83430cdc2ff43cc1"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "a64a1adf1552fa2de0e9758dcd2c9ddb"
server_key_iv: "c4e5823e8a22769acfd4d3d1576c94dd"
server_key_version: "encryptionkey@0"
I20260807 19:58:35.157466 28732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:35.168706 28732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:35.172339 28732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:35.172596 28732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:35.173517 28732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:35.174784 28732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:35.174880 28732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:35.174983 28732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:35.175050 28732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:35.205760 28732 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41291
I20260807 19:58:35.205848 28914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41291 every 8 connection(s)
I20260807 19:58:35.207195 28732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:58:35.212268 28917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:35.210009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:51053)
0807 19:58:35.210820 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:35.211104 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":309,"threads_started":1}
W20260807 19:58:35.212982 28915 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:43119 (0 consecutive failures): Network error: Failed to ping master at 127.5.197.190:43119: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
I20260807 19:58:35.213750 28917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:35.213438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:38955)
0807 19:58:35.213582 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:35.213650 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 19:58:35.214630 28917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:35.214325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:48991)
0807 19:58:35.214457 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:35.214528 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 19:58:35.214913 28915 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:58:35.217006 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 28732
I20260807 19:58:35.217777 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:39321
--local_ip_for_outbound_sockets=127.5.197.131
--tserver_master_addrs=127.5.197.190:43119
--webserver_port=38189
--webserver_interface=127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:35.551626 28918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:35.552006 28918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:35.552156 28918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:35.559232 28918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:35.559332 28918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:35.559482 28918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:58:35.569103 28918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:39321
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=38189
--tserver_master_addrs=127.5.197.190:43119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:35.570312 28918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:35.571616 28918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:35.584276 28928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:35.584192 28931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:35.584347 28927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:35.585083 28918 server_base.cc:1034] running on GCE node
I20260807 19:58:35.585626 28918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:35.586488 28918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:35.587707 28918 hybrid_clock.cc:648] HybridClock initialized: now 1786132715587635 us; error 37 us; skew 500 ppm
I20260807 19:58:35.588011 28918 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:35 dist-test-slave-6bbx krb5kdc[26710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132715, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:35.591252 28918 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:58:35.592587 28918 webserver.cc:460] Webserver started at http://127.5.197.131:38189/ using document root <none> and password file <none>
I20260807 19:58:35.593242 28918 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:35.593360 28918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:35.598480 28918 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 19:58:35.601190 28941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:35.602476 28918 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:58:35.602619 28918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "e80c979b07be45e5bd871a051947fb99"
format_stamp: "Formatted at 2026-08-07 19:58:29 on dist-test-slave-6bbx"
server_key: "b1a0d03c3ed9831a6b9e352d72bdb6d7"
server_key_iv: "2082ea5b0a33be2c5ca5c7d1990ec21a"
server_key_version: "encryptionkey@0"
I20260807 19:58:35.603555 28918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:35.630082 28918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:35.634142 28918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:35.634395 28918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:35.635327 28918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:35.636655 28918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:35.636744 28918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:35.636849 28918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:35.636919 28918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:35.667171 28918 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39321
I20260807 19:58:35.667229 29100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39321 every 8 connection(s)
I20260807 19:58:35.668664 28918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:58:35.673213 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:35.671420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:37043)
0807 19:58:35.672162 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:35.672394 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":299,"threads_started":1}
W20260807 19:58:35.673817 29102 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:43119 (0 consecutive failures): Network error: Failed to ping master at 127.5.197.190:43119: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
I20260807 19:58:35.674543 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:35.674250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:43471)
0807 19:58:35.674379 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:35.674444 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 19:58:35.675411 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:35.675068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:34799)
0807 19:58:35.675196 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:35.675284 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 19:58:35.675586 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 28918
W20260807 19:58:35.675652 29102 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:58:35.774984 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:35.774193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:43047)
0807 19:58:35.774654 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:35.774759 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":241,"threads_started":1}
I20260807 19:58:36.216192 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:36.215399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:56397)
0807 19:58:36.215875 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:36.215959 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":204,"threads_started":1}
I20260807 19:58:36.676916 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:36.676175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:37835)
0807 19:58:36.676591 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:36.676675 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":194,"threads_started":1}
I20260807 19:58:36.776497 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:36.775791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:45577)
0807 19:58:36.776254 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:36.776338 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":238,"threads_started":1}
I20260807 19:58:37.217718 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:37.217007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:55219)
0807 19:58:37.217484 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:37.217560 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":247,"threads_started":1}
I20260807 19:58:37.678347 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:37.677655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:49885)
0807 19:58:37.678104 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:37.678185 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":220,"threads_started":1}
I20260807 19:58:37.777937 29113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:37.777263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:40303)
0807 19:58:37.777694 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:37.777774 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":236,"threads_started":1}
I20260807 19:58:38.219225 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:38.218534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:52187)
0807 19:58:38.218974 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:38.219053 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":232,"threads_started":1}
I20260807 19:58:38.679908 29117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:38.679180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:51245)
0807 19:58:38.679613 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:38.679719 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":235,"threads_started":1}
I20260807 19:58:38.779429 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:38.778710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:53049)
0807 19:58:38.779128 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:38.779214 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":204,"threads_started":1}
I20260807 19:58:39.220907 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:39.220114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:46519)
0807 19:58:39.220620 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:39.220697 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":276,"threads_started":1}
I20260807 19:58:39.681401 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:39.680685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:55849)
0807 19:58:39.681135 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:39.681214 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":239,"threads_started":1}
I20260807 19:58:39.781064 29122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:39.780317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:38175)
0807 19:58:39.780803 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:39.780890 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":246,"threads_started":1}
I20260807 19:58:40.222452 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:40.221736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:56295)
0807 19:58:40.222196 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:40.222282 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":225,"threads_started":1}
I20260807 19:58:40.682930 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:40.682228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:56181)
0807 19:58:40.682687 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:40.682767 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":233,"threads_started":1}
I20260807 19:58:40.782604 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:40.781918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:59261)
0807 19:58:40.782347 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:40.782439 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":220,"threads_started":1}
I20260807 19:58:41.224074 29128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:41.223316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:38343)
0807 19:58:41.223800 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:41.223893 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":225,"threads_started":1}
I20260807 19:58:41.684514 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:41.683770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:59637)
0807 19:58:41.684243 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:41.684346 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":243,"threads_started":1}
I20260807 19:58:41.784330 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:41.783488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:46065)
0807 19:58:41.784022 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:41.784108 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":255,"threads_started":1}
I20260807 19:58:42.225740 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:42.224919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:55961)
0807 19:58:42.225434 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:42.225518 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":223,"threads_started":1}
I20260807 19:58:42.686126 29136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:42.685356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:57437)
0807 19:58:42.685831 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:42.685910 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":202,"threads_started":1}
I20260807 19:58:42.785934 29137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:42.785213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:41785)
0807 19:58:42.785664 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:42.785751 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":234,"threads_started":1}
I20260807 19:58:43.227361 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:43.226644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:58865)
0807 19:58:43.227093 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:43.227176 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":229,"threads_started":1}
I20260807 19:58:43.687655 29139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:43.686969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:54401)
0807 19:58:43.687406 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:43.687490 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":229,"threads_started":1}
I20260807 19:58:43.787472 29140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:43.786744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:35541)
0807 19:58:43.787195 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:43.787299 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":213,"threads_started":1}
I20260807 19:58:44.228964 29141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:44.228217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:41313)
0807 19:58:44.228692 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:44.228773 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":241,"threads_started":1}
I20260807 19:58:44.689232 29142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:44.688488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:47317)
0807 19:58:44.688978 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:44.689057 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":218,"threads_started":1}
I20260807 19:58:44.789011 29146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:44.788319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:55363)
0807 19:58:44.788767 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:44.788852 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":250,"threads_started":1}
I20260807 19:58:45.230784 29147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:45.229954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:59809)
0807 19:58:45.230504 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:45.230600 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":312,"threads_started":1}
I20260807 19:58:45.690835 29148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:45.690085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:59867)
0807 19:58:45.690590 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:45.690669 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":309,"threads_started":1}
I20260807 19:58:45.790482 29149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:45.789801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:43573)
0807 19:58:45.790192 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:45.790304 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":191,"threads_started":1}
I20260807 19:58:46.232568 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:46.231788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:58473)
0807 19:58:46.232294 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:46.232383 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":246,"threads_started":1}
I20260807 19:58:46.692374 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:46.691609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:59367)
0807 19:58:46.692105 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:46.692200 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":278,"threads_started":1}
I20260807 19:58:46.791994 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:46.791256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:60675)
0807 19:58:46.791752 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:46.791834 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":229,"threads_started":1}
I20260807 19:58:47.234128 29153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:47.233435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:57061)
0807 19:58:47.233886 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:47.233968 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":223,"threads_started":1}
I20260807 19:58:47.693892 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:47.693201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:49419)
0807 19:58:47.693655 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:47.693734 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":246,"threads_started":1}
I20260807 19:58:47.793596 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:47.792838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:39243)
0807 19:58:47.793303 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:47.793410 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":236,"threads_started":1}
I20260807 19:58:48.235838 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:48.235010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:41503)
0807 19:58:48.235492 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:48.235615 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":259,"threads_started":1}
I20260807 19:58:48.695446 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:48.694715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:58475)
0807 19:58:48.695166 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:48.695263 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":220,"threads_started":1}
I20260807 19:58:48.795035 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:48.794366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:40133)
0807 19:58:48.794781 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:48.794861 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":203,"threads_started":1}
I20260807 19:58:49.237443 29161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:49.236702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:41171)
0807 19:58:49.237162 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:49.237243 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":217,"threads_started":1}
I20260807 19:58:49.696982 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:49.696289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:49109)
0807 19:58:49.696703 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:49.696798 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":208,"threads_started":1}
I20260807 19:58:49.796741 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:49.796034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.129:52429)
0807 19:58:49.796469 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:49.796558 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":220,"threads_started":1}
I20260807 19:58:50.239292 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:50.238506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.130:43027)
0807 19:58:50.238988 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:50.239093 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":248,"threads_started":1}
I20260807 19:58:50.678896 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 28485
I20260807 19:58:50.696054 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:50.680099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33666 (local address 127.5.197.129:36281)
0807 19:58:50.680828 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:50.680847 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:50.680890 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:58:50.682545 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:50.682555 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:50.682984 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:50.683287 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:50.684754 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:50.686040 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:50.687329 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:50.688056 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:50.688199 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:50.690649 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:50.690657 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:50.690671 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:50.690703 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:50.693334 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:50.693945 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:50.693951 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:50.693957 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:50.694114 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:50.694411 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:50.694413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:50.694415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:50.694900 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:50.695125 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:50.695420 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 19:58:50.695777 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":370,"threads_started":1}
I20260807 19:58:50.697396 28722 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:50.698899 29171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:50.697965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43119 (local address 127.5.197.131:43197)
0807 19:58:50.698437 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:50.698674 (+ 237us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":247,"threads_started":1}
I20260807 19:58:50.781354 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 28485
I20260807 19:58:50.802736 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 28732
I20260807 19:58:50.819564 29172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:50.803718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45694 (local address 127.5.197.130:41291)
0807 19:58:50.804250 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:50.804265 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:50.804307 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:58:50.805780 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:50.805789 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:50.806220 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:50.806531 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:50.808044 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:50.809274 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:50.810474 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:50.811140 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:50.811276 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:50.813872 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:50.813880 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:50.813895 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:50.813934 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:50.816730 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:50.817346 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:50.817352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:50.817358 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:50.817516 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:50.817800 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:50.817803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:50.817805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:50.818301 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:50.818538 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:50.818882 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 19:58:50.819263 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":243,"threads_started":1}
I20260807 19:58:50.820926 28910 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:50.903574 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 28732
I20260807 19:58:50.925345 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 28918
I20260807 19:58:50.943209 29174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:50.926364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49480 (local address 127.5.197.131:39321)
0807 19:58:50.927002 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:50.927017 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:50.927060 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:58:50.928773 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:50.928783 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:50.929216 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:50.929502 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:50.930946 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:50.932549 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:50.933821 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:50.934509 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:50.934647 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:50.937214 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:50.937222 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:50.937238 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:50.937282 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:50.940264 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:50.940895 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:50.940901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:50.940907 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:50.941071 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:50.941353 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:50.941356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:50.941358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:50.941893 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:50.942119 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:50.942494 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 19:58:50.942905 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":302,"threads_started":1}
I20260807 19:58:50.944674 29096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:51.026841 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 28918
2026-08-07T19:58:51Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24929 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:58:51 dist-test-slave-6bbx krb5kdc[29179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:58:51 dist-test-slave-6bbx krb5kdc[29179](info): set up 2 sockets
Aug 07 19:58:51 dist-test-slave-6bbx krb5kdc[29179](info): commencing operation
krb5kdc: starting...
W20260807 19:58:52.232810 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.001s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:58:52 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:58:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:58:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:58:52.502597 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37355
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:52.830567 29199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:52.830852 29199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:52.830983 29199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:52.837952 29199 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 19:58:52.838050 29199 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 19:58:52.838112 29199 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 19:58:52.838191 29199 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:58:52.838263 29199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:52.838363 29199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:52.838423 29199 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:58:52.838498 29199 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:58:52.847937 29199 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:52.849128 29199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:52.850440 29199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:52.862239 29211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:52.862202 29212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:52.862239 29199 server_base.cc:1034] running on GCE node
W20260807 19:58:52.862432 29214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:52.863374 29199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:52.864738 29199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:52.865964 29199 hybrid_clock.cc:648] HybridClock initialized: now 1786132732865904 us; error 50 us; skew 500 ppm
I20260807 19:58:52.866303 29199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:52 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132732, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:52.872010 29199 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:58:52.873327 29199 webserver.cc:460] Webserver started at http://127.5.197.190:39499/ using document root <none> and password file <none>
I20260807 19:58:52.873955 29199 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:52.874040 29199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:52.874295 29199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:52.877481 29199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "41f9e3ccf7a4447eb508f35211430569"
format_stamp: "Formatted at 2026-08-07 19:58:52 on dist-test-slave-6bbx"
server_key: "8b2a74efce3a8432e6fa524ad9faeac8"
server_key_iv: "e80b30b11b95572aefd14731236f1822"
server_key_version: "encryptionkey@0"
I20260807 19:58:52.878196 29199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "41f9e3ccf7a4447eb508f35211430569"
format_stamp: "Formatted at 2026-08-07 19:58:52 on dist-test-slave-6bbx"
server_key: "8b2a74efce3a8432e6fa524ad9faeac8"
server_key_iv: "e80b30b11b95572aefd14731236f1822"
server_key_version: "encryptionkey@0"
I20260807 19:58:52.883018 29199 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:58:52.886307 29222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:52.887564 29199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:58:52.887748 29199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "41f9e3ccf7a4447eb508f35211430569"
format_stamp: "Formatted at 2026-08-07 19:58:52 on dist-test-slave-6bbx"
server_key: "8b2a74efce3a8432e6fa524ad9faeac8"
server_key_iv: "e80b30b11b95572aefd14731236f1822"
server_key_version: "encryptionkey@0"
I20260807 19:58:52.887940 29199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:52.899816 29199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:52.903635 29199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:52.903892 29199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:52.920766 29199 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37355
I20260807 19:58:52.920797 29288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37355 every 8 connection(s)
I20260807 19:58:52.922015 29199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:58:52.925491 29289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:52.927574 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 29199
I20260807 19:58:52.927821 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:58:52.928668 5910 external_mini_cluster.cc:1428] Setting key a1005ec5e410ae18ccd07860f3d0c0e2
I20260807 19:58:52.937507 29289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Bootstrap starting.
I20260807 19:58:52.941130 29289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:52.942404 29289 log.cc:824] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:58:52 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:52.945307 29289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: No bootstrap required, opened a new log
I20260807 19:58:52.951208 29293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:52.930692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35306 (local address 127.5.197.190:37355)
0807 19:58:52.931478 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:52.931492 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:52.931534 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:58:52.933187 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:52.933209 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:52.933546 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:52.933867 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:52.935627 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:52.936929 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:52.938686 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:52.939345 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:52.939474 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:52.944368 (+ 4894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:52.944376 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:52.944389 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:52.944423 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:52.947294 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:52.948122 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:52.948128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:52.948133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:52.948304 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:52.948670 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:52.948673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:52.948675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:52.949204 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:52.949432 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:52.949869 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 19:58:52.950203 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":326,"threads_started":1}
I20260807 19:58:52.953536 29289 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:58:52.953867 29289 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:52.953974 29289 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9e3ccf7a4447eb508f35211430569, State: Initialized, Role: FOLLOWER
I20260807 19:58:52.954466 29289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:58:52.954676 29289 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:58:52.954797 29289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:58:52.954948 29289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:52.957041 29289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:58:52.957484 29289 leader_election.cc:302] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41f9e3ccf7a4447eb508f35211430569; no voters:
I20260807 19:58:52.958060 29289 leader_election.cc:288] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:58:52.958164 29295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:52.958777 29295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 LEADER]: Becoming Leader. State: Replica: 41f9e3ccf7a4447eb508f35211430569, State: Running, Role: LEADER
I20260807 19:58:52.959379 29295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:58:52.960254 29289 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:58:52.962400 29296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41f9e3ccf7a4447eb508f35211430569" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } } }
I20260807 19:58:52.962455 29298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41f9e3ccf7a4447eb508f35211430569. Latest consensus state: current_term: 1 leader_uuid: "41f9e3ccf7a4447eb508f35211430569" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } } }
I20260807 19:58:52.963094 29296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:52.963125 29298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: This master's current role is: LEADER
I20260807 19:58:52.963912 29308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:58:52.968727 29308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:58:52.977035 29308 catalog_manager.cc:1347] Generated new cluster ID: e75bb0b2cf18493eb8d2a40d2260f6df
I20260807 19:58:52.977133 29308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:58:52.993280 29308 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:58:52.994449 29308 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:58:53.011137 29308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Generated new TSK 0
I20260807 19:58:53.012255 29308 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:58:53.095064 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37355
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:53.431062 29327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:53.431324 29327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:53.431458 29327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:53.438705 29327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:53.438817 29327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:53.438971 29327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:58:53.448613 29327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:53.449792 29327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:53.451068 29327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:53.464130 29338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:53.464200 29341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:53.464226 29337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:53.464993 29327 server_base.cc:1034] running on GCE node
I20260807 19:58:53.465592 29327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:53.466464 29327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:53.467655 29327 hybrid_clock.cc:648] HybridClock initialized: now 1786132733467606 us; error 38 us; skew 500 ppm
I20260807 19:58:53.467983 29327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:53 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132733, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:53.470963 29327 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:58:53.472294 29327 webserver.cc:460] Webserver started at http://127.5.197.129:37751/ using document root <none> and password file <none>
I20260807 19:58:53.472952 29327 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:53.473071 29327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:53.473363 29327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:53.476203 29327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "f4e696e845094be08fbeda01f14e3f44"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "bff13906703ee817e7f1e23ac989f24d"
server_key_iv: "610972c8d1b6199b431f13181ef5d9b2"
server_key_version: "encryptionkey@0"
I20260807 19:58:53.476948 29327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "f4e696e845094be08fbeda01f14e3f44"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "bff13906703ee817e7f1e23ac989f24d"
server_key_iv: "610972c8d1b6199b431f13181ef5d9b2"
server_key_version: "encryptionkey@0"
I20260807 19:58:53.481760 29327 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:58:53.485108 29348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:53.486320 29327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:58:53.486469 29327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "f4e696e845094be08fbeda01f14e3f44"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "bff13906703ee817e7f1e23ac989f24d"
server_key_iv: "610972c8d1b6199b431f13181ef5d9b2"
server_key_version: "encryptionkey@0"
I20260807 19:58:53.486650 29327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:53.507817 29327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:53.511643 29327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:53.511941 29327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:53.512871 29327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:53.514189 29327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:53.514272 29327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:53.514392 29327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:53.514446 29327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:53.545017 29327 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:45263
I20260807 19:58:53.545083 29500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:45263 every 8 connection(s)
I20260807 19:58:53.546270 29327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:58:53.553787 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 29327
I20260807 19:58:53.554004 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:58:53.554651 5910 external_mini_cluster.cc:1428] Setting key 95db132c5a14c23dcddbc810e3a3d867
Aug 07 19:58:53 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132733, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:53.566140 29504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:53.548794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:56543 (local address 127.5.197.190:37355)
0807 19:58:53.549283 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:53.549288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:53.550187 (+ 899us) server_negotiation.cc:407] Connection header received
0807 19:58:53.552050 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:53.552054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:53.552122 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:53.552207 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:53.553683 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:53.554478 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:53.556372 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:53.556924 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:53.557052 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:53.560580 (+ 3528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:53.560585 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:53.560588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:53.560620 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:53.563172 (+ 2552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:53.564017 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:53.564021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:53.564023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:53.564139 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:53.564555 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:53.564558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:53.564560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:53.564820 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:53.564939 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:53.565705 (+ 766us) server_negotiation.cc:299] Negotiation successful
0807 19:58:53.565899 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":248,"threads_started":1}
I20260807 19:58:53.567399 29505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:53.549336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:56543)
0807 19:58:53.550029 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:53.550073 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:53.551795 (+ 1722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:53.552430 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:53.552438 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:53.552926 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:53.553510 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:53.553529 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:53.554629 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:53.554639 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:53.556224 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:53.556238 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:53.557153 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:53.557158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:53.557365 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:53.558026 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:53.558053 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:53.560375 (+ 2322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:53.563305 (+ 2930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:53.563313 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:53.563328 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:53.563913 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:53.564235 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:53.564239 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:53.564243 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:53.564469 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:53.564939 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:53.564946 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:53.565339 (+ 393us) client_negotiation.cc:769] Sending connection context
0807 19:58:53.565625 (+ 286us) client_negotiation.cc:240] Negotiation successful
0807 19:58:53.566110 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":253,"threads_started":1}
I20260807 19:58:53.568903 29501 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37355
I20260807 19:58:53.569192 29501 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:53.570024 29501 heartbeater.cc:511] Master 127.5.197.190:37355 requested a full tablet report, sending...
I20260807 19:58:53.572268 29244 ts_manager.cc:194] Registered new tserver with Master: f4e696e845094be08fbeda01f14e3f44 (127.5.197.129:45263)
I20260807 19:58:53.573690 29244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:56543
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:58:53.620514 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37355
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:53.948424 29510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:53.948676 29510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:53.948796 29510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:53.955858 29510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:53.955966 29510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:53.956121 29510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:58:53.965483 29510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:53.966662 29510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:53.967923 29510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:53.980564 29518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:53.980500 29519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:53.980535 29522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:53.981402 29510 server_base.cc:1034] running on GCE node
I20260807 19:58:53.981964 29510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:53.982862 29510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:53.984055 29510 hybrid_clock.cc:648] HybridClock initialized: now 1786132733984015 us; error 31 us; skew 500 ppm
I20260807 19:58:53.984330 29510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:53 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132733, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:53.987277 29510 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:58:53.988667 29510 webserver.cc:460] Webserver started at http://127.5.197.130:34595/ using document root <none> and password file <none>
I20260807 19:58:53.989298 29510 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:53.989413 29510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:53.989702 29510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:53.992776 29510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "86591ec5540a4f42ab5029eb6e685d72"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "84eca2a4b07019af5dcaa9ecfb3023fc"
server_key_iv: "ba87566e36db5e081b35ff71642196a6"
server_key_version: "encryptionkey@0"
I20260807 19:58:53.993496 29510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "86591ec5540a4f42ab5029eb6e685d72"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "84eca2a4b07019af5dcaa9ecfb3023fc"
server_key_iv: "ba87566e36db5e081b35ff71642196a6"
server_key_version: "encryptionkey@0"
I20260807 19:58:53.998332 29510 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:58:54.001613 29535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:54.002821 29510 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:58:54.002978 29510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "86591ec5540a4f42ab5029eb6e685d72"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "84eca2a4b07019af5dcaa9ecfb3023fc"
server_key_iv: "ba87566e36db5e081b35ff71642196a6"
server_key_version: "encryptionkey@0"
I20260807 19:58:54.003154 29510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:54.045210 29510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:54.049211 29510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:54.049489 29510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:54.050452 29510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:54.051785 29510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:54.051870 29510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:54.051994 29510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:54.052048 29510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:54.082410 29510 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:34457
I20260807 19:58:54.082453 29688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:34457 every 8 connection(s)
I20260807 19:58:54.083616 29510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:58:54.087018 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 29510
I20260807 19:58:54.087198 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:58:54.087695 5910 external_mini_cluster.cc:1428] Setting key aec6888e9a5a338577e083c6d11a09d6
Aug 07 19:58:54 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132733, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:54.102847 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.086077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:60339 (local address 127.5.197.190:37355)
0807 19:58:54.086528 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.086534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.087569 (+ 1035us) server_negotiation.cc:407] Connection header received
0807 19:58:54.089437 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.089443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.089518 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.089611 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:54.091136 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.092008 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.093596 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.094011 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.094118 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.097511 (+ 3393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:54.097516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:54.097519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:54.097549 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:54.099971 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:54.100646 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:54.100650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:54.100652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:54.100775 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:54.101178 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:54.101183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:54.101185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:54.101442 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:54.101588 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.102224 (+ 636us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.102443 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":232,"threads_started":1}
I20260807 19:58:54.104575 29693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.086636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:60339)
0807 19:58:54.087390 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:54.087440 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:54.089165 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:54.089848 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:54.089865 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:54.090399 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:54.090980 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.090998 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.092152 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.092157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.093461 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.093474 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.094227 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.094235 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.094443 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.095062 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:54.095083 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:54.097296 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:54.100097 (+ 2801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:54.100106 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:54.100121 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:54.100535 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:54.100878 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:54.100883 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:54.100887 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:54.101067 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:54.101568 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:54.101575 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:54.101872 (+ 297us) client_negotiation.cc:769] Sending connection context
0807 19:58:54.102105 (+ 233us) client_negotiation.cc:240] Negotiation successful
0807 19:58:54.103553 (+ 1448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":298,"threads_started":1}
I20260807 19:58:54.105921 29689 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37355
I20260807 19:58:54.106208 29689 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:54.106923 29689 heartbeater.cc:511] Master 127.5.197.190:37355 requested a full tablet report, sending...
I20260807 19:58:54.108338 29244 ts_manager.cc:194] Registered new tserver with Master: 86591ec5540a4f42ab5029eb6e685d72 (127.5.197.130:34457)
I20260807 19:58:54.109107 29244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:60339
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:58:54.150563 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37355
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:58:54.481654 29698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:58:54.481910 29698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:58:54.482040 29698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:58:54.489049 29698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:58:54.489156 29698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:58:54.489305 29698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:58:54.498795 29698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:58:54.499965 29698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:58:54.501292 29698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:58:54.513960 29706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:54.513890 29707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:58:54.514075 29709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:58:54.514923 29698 server_base.cc:1034] running on GCE node
I20260807 19:58:54.515478 29698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:58:54.516361 29698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:58:54.517571 29698 hybrid_clock.cc:648] HybridClock initialized: now 1786132734517506 us; error 50 us; skew 500 ppm
I20260807 19:58:54.517853 29698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:58:54 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132734, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:58:54.520748 29698 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:58:54.522035 29698 webserver.cc:460] Webserver started at http://127.5.197.131:34593/ using document root <none> and password file <none>
I20260807 19:58:54.522681 29698 fs_manager.cc:359] Metadata directory not provided
I20260807 19:58:54.522799 29698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:58:54.523095 29698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:58:54.525899 29698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "a83c10df283e490c8d29f54eba9928c3"
format_stamp: "Formatted at 2026-08-07 19:58:54 on dist-test-slave-6bbx"
server_key: "a4f9d2cbbabebfd49f8f1dca464ffa6c"
server_key_iv: "17c6c65857b824027d03b0fd8c75ba23"
server_key_version: "encryptionkey@0"
I20260807 19:58:54.526613 29698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "a83c10df283e490c8d29f54eba9928c3"
format_stamp: "Formatted at 2026-08-07 19:58:54 on dist-test-slave-6bbx"
server_key: "a4f9d2cbbabebfd49f8f1dca464ffa6c"
server_key_iv: "17c6c65857b824027d03b0fd8c75ba23"
server_key_version: "encryptionkey@0"
I20260807 19:58:54.531464 29698 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260807 19:58:54.534817 29717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:54.536098 29698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:58:54.536252 29698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "a83c10df283e490c8d29f54eba9928c3"
format_stamp: "Formatted at 2026-08-07 19:58:54 on dist-test-slave-6bbx"
server_key: "a4f9d2cbbabebfd49f8f1dca464ffa6c"
server_key_iv: "17c6c65857b824027d03b0fd8c75ba23"
server_key_version: "encryptionkey@0"
I20260807 19:58:54.536423 29698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:58:54.549914 29698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:58:54.553467 29698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:58:54.553712 29698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:58:54.554565 29698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:58:54.555799 29698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:58:54.555883 29698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:54.555999 29698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:58:54.556056 29698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:58:54.576601 29501 heartbeater.cc:503] Master 127.5.197.190:37355 was elected leader, sending a full tablet report...
I20260807 19:58:54.586335 29698 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:34995
I20260807 19:58:54.586380 29880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:34995 every 8 connection(s)
I20260807 19:58:54.587546 29698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:58:54.588337 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 29698
I20260807 19:58:54.588555 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:58:54.589130 5910 external_mini_cluster.cc:1428] Setting key 8ed3f8e1909495feb5a537e06c65d046
Aug 07 19:58:54 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132734, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:58:54.606660 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.590177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:54021 (local address 127.5.197.190:37355)
0807 19:58:54.590368 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.590373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.591838 (+ 1465us) server_negotiation.cc:407] Connection header received
0807 19:58:54.593776 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.593782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.593862 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.593942 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:54.595263 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.596052 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.597481 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.597850 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.597941 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.601024 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:54.601029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:54.601032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:54.601064 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:54.603940 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:54.604744 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:54.604749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:54.604752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:54.604913 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:54.605280 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:54.605283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:54.605285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:54.605545 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:54.605652 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.606234 (+ 582us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.606399 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:58:54.607600 29884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.590802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:54021)
0807 19:58:54.591650 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:54.591735 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:54.593529 (+ 1794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:54.594110 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:54.594117 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:54.594605 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:58:54.595141 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.595158 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.596175 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.596179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.597376 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.597388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.598006 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.598011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.598190 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.598756 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:58:54.598777 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:58:54.600818 (+ 2041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:58:54.604058 (+ 3240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:54.604067 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:54.604081 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:54.604637 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:54.605003 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:58:54.605006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:58:54.605009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:58:54.605187 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:58:54.605660 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:58:54.605665 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:58:54.605960 (+ 295us) client_negotiation.cc:769] Sending connection context
0807 19:58:54.606182 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 19:58:54.606559 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":337,"threads_started":1}
I20260807 19:58:54.608752 29881 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37355
I20260807 19:58:54.609011 29881 heartbeater.cc:464] Registering TS with master...
I20260807 19:58:54.609658 29881 heartbeater.cc:511] Master 127.5.197.190:37355 requested a full tablet report, sending...
I20260807 19:58:54.610893 29244 ts_manager.cc:194] Registered new tserver with Master: a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995)
I20260807 19:58:54.611634 29244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:54021
I20260807 19:58:54.616679 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:58:54.632773 29692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.620942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35316 (local address 127.5.197.190:37355)
0807 19:58:54.621088 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.621092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.621591 (+ 499us) server_negotiation.cc:407] Connection header received
0807 19:58:54.621700 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.621703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.621761 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.621841 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:54.623234 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.624014 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.625456 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.625865 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.625957 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.628224 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:54.628229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:54.628232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:54.628261 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:54.630570 (+ 2309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:54.631104 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:54.631107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:54.631109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:54.631293 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:54.631561 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:54.631564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:54.631566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:54.631876 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:54.632058 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.632321 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.632494 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 19:58:54.636337 29244 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:58:54.643101 29244 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:58:54.680608 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.655241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53066 (local address 127.5.197.129:45263)
0807 19:58:54.672578 (+ 17337us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.672586 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.672613 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:58:54.672768 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.672776 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.672985 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.673212 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:54.673916 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.675438 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.678131 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.679450 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.679572 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.679812 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.680125 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.680279 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17179,"thread_start_us":16337,"threads_started":1}
I20260807 19:58:54.680646 29900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.654579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:45263 (local address 127.0.0.1:53066)
0807 19:58:54.670704 (+ 16125us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:54.670720 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:54.670818 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:54.673214 (+ 2396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:54.673218 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:54.673243 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:54.673761 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.673773 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.675604 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.675609 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.677995 (+ 2386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.678006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.679695 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.679703 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.679936 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.679960 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:58:54.680057 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 19:58:54.680245 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16015,"mutex_wait_us":116,"thread_start_us":15877,"threads_started":1}
I20260807 19:58:54.680712 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.655419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.5.197.130:34457)
0807 19:58:54.671407 (+ 15988us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.671418 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.672207 (+ 789us) server_negotiation.cc:407] Connection header received
0807 19:58:54.672317 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.672325 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.672577 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.672814 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:54.673865 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.674915 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.677899 (+ 2984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.679291 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.679415 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.679588 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.680217 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.680380 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15783,"thread_start_us":15630,"threads_started":1}
I20260807 19:58:54.680702 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.654688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.5.197.131:34995)
0807 19:58:54.672284 (+ 17596us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.672292 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.672325 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:58:54.672434 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.672442 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.672671 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.672879 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:54.673797 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.675499 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.677708 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.679102 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.679230 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.679459 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.680205 (+ 746us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.680364 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17428,"thread_start_us":17263,"threads_started":1}
I20260807 19:58:54.681469 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.654927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:34457 (local address 127.0.0.1:57654)
0807 19:58:54.672052 (+ 17125us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:54.672069 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:54.672183 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:54.673078 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:54.673082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:54.673113 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:54.673649 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.673661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.675078 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.675083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.677738 (+ 2655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.677753 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.679754 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.679760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.679978 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.680003 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:58:54.680070 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 19:58:54.680977 (+ 907us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17007,"mutex_wait_us":912,"thread_start_us":16863,"threads_started":1}
I20260807 19:58:54.681510 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.654479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:34995 (local address 127.0.0.1:45308)
0807 19:58:54.670428 (+ 15949us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:54.670480 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:54.670678 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:54.673003 (+ 2325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:54.673010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:54.673040 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:54.673563 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.673577 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.675642 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.675647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.677511 (+ 1864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.677566 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.679612 (+ 2046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.679619 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.679873 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.679931 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 19:58:54.680067 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 19:58:54.680977 (+ 910us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15692,"mutex_wait_us":781,"thread_start_us":15192,"threads_started":1}
I20260807 19:58:54.684713 29599 tablet_service.cc:1467] Processing CreateTablet for tablet e6116c06828e4cfe87cc1c62594c560d (DEFAULT_TABLE table=test-table [id=085ac98f92e146539afaecf061675f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:54.684716 29414 tablet_service.cc:1467] Processing CreateTablet for tablet e6116c06828e4cfe87cc1c62594c560d (DEFAULT_TABLE table=test-table [id=085ac98f92e146539afaecf061675f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:54.685860 29599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6116c06828e4cfe87cc1c62594c560d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:54.685877 29414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6116c06828e4cfe87cc1c62594c560d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:54.690083 29783 tablet_service.cc:1467] Processing CreateTablet for tablet e6116c06828e4cfe87cc1c62594c560d (DEFAULT_TABLE table=test-table [id=085ac98f92e146539afaecf061675f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:58:54.691471 29783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6116c06828e4cfe87cc1c62594c560d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:58:54.697327 29909 tablet_bootstrap.cc:492] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Bootstrap starting.
I20260807 19:58:54.699388 29910 tablet_bootstrap.cc:492] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Bootstrap starting.
I20260807 19:58:54.701056 29909 tablet_bootstrap.cc:654] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:54.702448 29909 log.cc:824] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:54.702840 29910 tablet_bootstrap.cc:654] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:54.703995 29910 log.cc:824] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:54.705349 29915 tablet_bootstrap.cc:492] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Bootstrap starting.
I20260807 19:58:54.705750 29909 tablet_bootstrap.cc:492] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: No bootstrap required, opened a new log
I20260807 19:58:54.706037 29909 ts_tablet_manager.cc:1397] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 19:58:54.706974 29910 tablet_bootstrap.cc:492] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: No bootstrap required, opened a new log
I20260807 19:58:54.707233 29910 ts_tablet_manager.cc:1397] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260807 19:58:54.709075 29915 tablet_bootstrap.cc:654] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Neither blocks nor log segments found. Creating new log.
I20260807 19:58:54.710261 29915 log.cc:824] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Log is configured to *not* fsync() on all Append() calls
I20260807 19:58:54.713212 29915 tablet_bootstrap.cc:492] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: No bootstrap required, opened a new log
I20260807 19:58:54.713464 29915 ts_tablet_manager.cc:1397] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 19:58:54.715260 29910 raft_consensus.cc:348] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.715593 29910 raft_consensus.cc:374] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:54.715701 29910 raft_consensus.cc:729] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86591ec5540a4f42ab5029eb6e685d72, State: Initialized, Role: FOLLOWER
I20260807 19:58:54.716254 29910 consensus_queue.cc:260] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.716475 29909 raft_consensus.cc:348] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.716882 29909 raft_consensus.cc:374] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:54.716982 29909 raft_consensus.cc:729] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4e696e845094be08fbeda01f14e3f44, State: Initialized, Role: FOLLOWER
I20260807 19:58:54.717388 29689 heartbeater.cc:503] Master 127.5.197.190:37355 was elected leader, sending a full tablet report...
I20260807 19:58:54.717667 29909 consensus_queue.cc:260] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.719455 29909 ts_tablet_manager.cc:1428] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
I20260807 19:58:54.719465 29910 ts_tablet_manager.cc:1428] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260807 19:58:54.724455 29915 raft_consensus.cc:348] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.724779 29915 raft_consensus.cc:374] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:58:54.724874 29915 raft_consensus.cc:729] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83c10df283e490c8d29f54eba9928c3, State: Initialized, Role: FOLLOWER
I20260807 19:58:54.725387 29915 consensus_queue.cc:260] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.726294 29881 heartbeater.cc:503] Master 127.5.197.190:37355 was elected leader, sending a full tablet report...
I20260807 19:58:54.726897 29915 ts_tablet_manager.cc:1428] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Time spent starting tablet: real 0.013s user 0.003s sys 0.009s
W20260807 19:58:54.798482 29503 tablet.cc:2369] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:58:54.835542 29690 tablet.cc:2369] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:58:54.839257 29882 tablet.cc:2369] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:58:54.957000 29919 raft_consensus.cc:482] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:58:54.957290 29919 raft_consensus.cc:504] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.958920 29919 leader_election.cc:288] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995), f4e696e845094be08fbeda01f14e3f44 (127.5.197.129:45263)
I20260807 19:58:54.966902 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.959463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:42705 (local address 127.5.197.131:34995)
0807 19:58:54.959639 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.959644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.960304 (+ 660us) server_negotiation.cc:407] Connection header received
0807 19:58:54.960515 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.960519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.960602 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.960676 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:54.961263 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.962353 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.964821 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.965992 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.966152 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.966229 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.966534 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.966655 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:58:54.966965 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.959378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:40379 (local address 127.5.197.129:45263)
0807 19:58:54.959593 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:54.959600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:54.960377 (+ 777us) server_negotiation.cc:407] Connection header received
0807 19:58:54.960850 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:54.960855 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:54.960932 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:54.961023 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:58:54.961694 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.962655 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.964939 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.966104 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.966240 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.966302 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:54.966614 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 19:58:54.966731 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:58:54.967021 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.959333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:34995 (local address 127.5.197.130:42705)
0807 19:58:54.960179 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:54.960220 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:54.960386 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:54.960722 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:54.960726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:54.960755 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:54.961106 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.961117 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.962486 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.962490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.964670 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.964687 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.966187 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.966194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.966364 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.966403 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:58:54.966504 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 19:58:54.966635 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":512,"threads_started":1}
I20260807 19:58:54.967376 29925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:54.959343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:45263 (local address 127.5.197.130:40379)
0807 19:58:54.960285 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0807 19:58:54.960301 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:58:54.960395 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:58:54.961071 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:58:54.961076 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:58:54.961105 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:58:54.961517 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.961530 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.962780 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.962785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.964791 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:58:54.964802 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:58:54.966309 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:58:54.966315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:58:54.966477 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:54.966506 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:58:54.966580 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 19:58:54.966674 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":819,"mutex_wait_us":36,"thread_start_us":426,"threads_started":1}
I20260807 19:58:54.968079 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6116c06828e4cfe87cc1c62594c560d" candidate_uuid: "86591ec5540a4f42ab5029eb6e685d72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83c10df283e490c8d29f54eba9928c3" is_pre_election: true
I20260807 19:58:54.968374 29441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6116c06828e4cfe87cc1c62594c560d" candidate_uuid: "86591ec5540a4f42ab5029eb6e685d72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4e696e845094be08fbeda01f14e3f44" is_pre_election: true
I20260807 19:58:54.968554 29814 raft_consensus.cc:2454] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86591ec5540a4f42ab5029eb6e685d72 in term 0.
I20260807 19:58:54.968840 29441 raft_consensus.cc:2454] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86591ec5540a4f42ab5029eb6e685d72 in term 0.
I20260807 19:58:54.969223 29542 leader_election.cc:302] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86591ec5540a4f42ab5029eb6e685d72, a83c10df283e490c8d29f54eba9928c3; no voters:
I20260807 19:58:54.969671 29919 raft_consensus.cc:2781] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:58:54.969794 29919 raft_consensus.cc:482] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:58:54.969892 29919 raft_consensus.cc:3037] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:54.972196 29919 raft_consensus.cc:504] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.972759 29919 leader_election.cc:288] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [CANDIDATE]: Term 1 election: Requested vote from peers a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995), f4e696e845094be08fbeda01f14e3f44 (127.5.197.129:45263)
I20260807 19:58:54.973170 29814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6116c06828e4cfe87cc1c62594c560d" candidate_uuid: "86591ec5540a4f42ab5029eb6e685d72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83c10df283e490c8d29f54eba9928c3"
I20260807 19:58:54.973232 29441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6116c06828e4cfe87cc1c62594c560d" candidate_uuid: "86591ec5540a4f42ab5029eb6e685d72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4e696e845094be08fbeda01f14e3f44"
I20260807 19:58:54.973349 29814 raft_consensus.cc:3037] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:54.973419 29441 raft_consensus.cc:3037] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:58:54.975477 29814 raft_consensus.cc:2454] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86591ec5540a4f42ab5029eb6e685d72 in term 1.
I20260807 19:58:54.975534 29441 raft_consensus.cc:2454] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86591ec5540a4f42ab5029eb6e685d72 in term 1.
I20260807 19:58:54.975867 29542 leader_election.cc:302] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86591ec5540a4f42ab5029eb6e685d72, a83c10df283e490c8d29f54eba9928c3; no voters:
I20260807 19:58:54.976128 29919 raft_consensus.cc:2781] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:58:54.976562 29919 raft_consensus.cc:686] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 1 LEADER]: Becoming Leader. State: Replica: 86591ec5540a4f42ab5029eb6e685d72, State: Running, Role: LEADER
I20260807 19:58:54.977101 29919 consensus_queue.cc:237] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } }
I20260807 19:58:54.981319 29244 catalog_manager.cc:5495] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86591ec5540a4f42ab5029eb6e685d72 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "86591ec5540a4f42ab5029eb6e685d72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } health_report { overall_health: HEALTHY } } }
I20260807 19:58:55.044801 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:55.039197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57670 (local address 127.5.197.130:34457)
0807 19:58:55.039408 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:55.039414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:55.039566 (+ 152us) server_negotiation.cc:407] Connection header received
0807 19:58:55.039805 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:55.039809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:55.039921 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:55.040051 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:58:55.040429 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.041154 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.042653 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.043058 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.043170 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:55.043650 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:58:55.044209 (+ 559us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:58:55.044345 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:55.044459 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 19:58:55.044543 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 19:58:55.052608 29814 raft_consensus.cc:1261] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Refusing update from remote peer 86591ec5540a4f42ab5029eb6e685d72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:55.052609 29441 raft_consensus.cc:1261] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 1 FOLLOWER]: Refusing update from remote peer 86591ec5540a4f42ab5029eb6e685d72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:58:55.053534 29927 consensus_queue.cc:1035] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:55.053887 29919 consensus_queue.cc:1035] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:58:55.081079 29242 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:55.081424 29242 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:58:55.085685 29242 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Sending DeleteTablet for 3 replicas of tablet e6116c06828e4cfe87cc1c62594c560d
I20260807 19:58:55.086833 29783 tablet_service.cc:1514] Processing DeleteTablet for tablet e6116c06828e4cfe87cc1c62594c560d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:55 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:45308
I20260807 19:58:55.088199 29414 tablet_service.cc:1514] Processing DeleteTablet for tablet e6116c06828e4cfe87cc1c62594c560d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:55 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:53066
I20260807 19:58:55.088352 29599 tablet_service.cc:1514] Processing DeleteTablet for tablet e6116c06828e4cfe87cc1c62594c560d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:58:55 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:57654
I20260807 19:58:55.089143 29951 tablet_replica.cc:330] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: stopping tablet replica
I20260807 19:58:55.089145 29948 tablet_replica.cc:330] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: stopping tablet replica
I20260807 19:58:55.089182 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 29327
I20260807 19:58:55.089567 29948 raft_consensus.cc:2229] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:55.089617 29951 raft_consensus.cc:2229] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:58:55.090193 29948 raft_consensus.cc:2258] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:55.090256 29951 raft_consensus.cc:2258] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:55.092914 29951 ts_tablet_manager.cc:1905] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:55.100330 29951 ts_tablet_manager.cc:1918] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:55.100559 29951 log.cc:1196] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/e6116c06828e4cfe87cc1c62594c560d
I20260807 19:58:55.101203 29951 ts_tablet_manager.cc:1939] T e6116c06828e4cfe87cc1c62594c560d P f4e696e845094be08fbeda01f14e3f44: Deleting consensus metadata
I20260807 19:58:55.101575 29948 ts_tablet_manager.cc:1905] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 19:58:55 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:58:55.103307 29225 catalog_manager.cc:4841] TS f4e696e845094be08fbeda01f14e3f44 (127.5.197.129:45263): tablet e6116c06828e4cfe87cc1c62594c560d (table test-table [id=085ac98f92e146539afaecf061675f3f]) successfully deleted
I20260807 19:58:55.111438 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:55.090435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53082 (local address 127.5.197.129:45263)
0807 19:58:55.090638 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:55.090644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:55.091072 (+ 428us) server_negotiation.cc:407] Connection header received
0807 19:58:55.091450 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:55.091457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:55.091543 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:55.091627 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:55.093901 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.095096 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.097037 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.097696 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.097787 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:55.103363 (+ 5576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:55.103378 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:55.103394 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:55.103431 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:55.107263 (+ 3832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:55.108314 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:55.108324 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:55.108328 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:55.108495 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:55.108998 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:55.109004 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:55.109008 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:55.109516 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:55.109795 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:55.110820 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0807 19:58:55.111060 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:58:55.113300 29494 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:55.116181 29954 tablet_replica.cc:330] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: stopping tablet replica
I20260807 19:58:55.116613 29948 ts_tablet_manager.cc:1918] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:55.116648 29954 raft_consensus.cc:2229] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:58:55.116801 29948 log.cc:1196] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/e6116c06828e4cfe87cc1c62594c560d
I20260807 19:58:55.117312 29948 ts_tablet_manager.cc:1939] T e6116c06828e4cfe87cc1c62594c560d P a83c10df283e490c8d29f54eba9928c3: Deleting consensus metadata
I20260807 19:58:55.117455 29954 raft_consensus.cc:2258] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:58:55.119925 29226 catalog_manager.cc:4841] TS a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995): tablet e6116c06828e4cfe87cc1c62594c560d (table test-table [id=085ac98f92e146539afaecf061675f3f]) successfully deleted
I20260807 19:58:55.120062 29954 ts_tablet_manager.cc:1905] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:58:55.127076 29954 ts_tablet_manager.cc:1918] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:58:55.127231 29954 log.cc:1196] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/e6116c06828e4cfe87cc1c62594c560d
I20260807 19:58:55.127686 29954 ts_tablet_manager.cc:1939] T e6116c06828e4cfe87cc1c62594c560d P 86591ec5540a4f42ab5029eb6e685d72: Deleting consensus metadata
I20260807 19:58:55.129168 29223 catalog_manager.cc:4841] TS 86591ec5540a4f42ab5029eb6e685d72 (127.5.197.130:34457): tablet e6116c06828e4cfe87cc1c62594c560d (table test-table [id=085ac98f92e146539afaecf061675f3f]) successfully deleted
I20260807 19:58:55.216058 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 29327
I20260807 19:58:55.240836 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 29510
Aug 07 19:58:55 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:58:55.258833 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:55.241640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57682 (local address 127.5.197.130:34457)
0807 19:58:55.241826 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:55.241832 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:55.242070 (+ 238us) server_negotiation.cc:407] Connection header received
0807 19:58:55.242323 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:55.242328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:55.242414 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:55.242512 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:55.244417 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.245242 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.247236 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.247902 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.248000 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:55.253017 (+ 5017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:55.253031 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:55.253047 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:55.253096 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:55.256045 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:55.256711 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:55.256719 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:55.256721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:55.256872 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:55.257233 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:55.257237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:55.257239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:55.257618 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:55.257945 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:55.258249 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 19:58:55.258479 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 19:58:55.259532 29681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:55.372370 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 29510
I20260807 19:58:55.398727 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 29698
Aug 07 19:58:55 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:58:55.413228 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:58:55.399439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45324 (local address 127.5.197.131:34995)
0807 19:58:55.399618 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 19:58:55.399623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:58:55.399644 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:58:55.399856 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:58:55.399867 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:58:55.399933 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:58:55.400013 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:58:55.401332 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.402034 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.403280 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:58:55.403644 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:58:55.403761 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:58:55.407987 (+ 4226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:58:55.408000 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:58:55.408016 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:58:55.408056 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:58:55.410802 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:55.411441 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:55.411448 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:55.411451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:55.411589 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:58:55.412003 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:58:55.412006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:58:55.412008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:58:55.412356 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:58:55.412585 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 19:58:55.412806 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 19:58:55.412969 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:58:55.413856 29875 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:55.502256 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 29698
I20260807 19:58:55.522837 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 29199
I20260807 19:58:55.523984 29282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:58:55.632385 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 29199
I20260807 19:59:15.660682 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37355
--webserver_interface=127.5.197.190
--webserver_port=39499
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:59:15.999537 29964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:15.999867 29964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:15.999966 29964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:16.007123 29964 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 19:59:16.007220 29964 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 19:59:16.007272 29964 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 19:59:16.007324 29964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:59:16.007377 29964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:16.007445 29964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:16.007496 29964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:59:16.007548 29964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:59:16.017277 29964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=39499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:16.018546 29964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:16.019918 29964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:16.044837 29975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:16.044765 29980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:16.044818 29976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:16.045135 29964 server_base.cc:1034] running on GCE node
I20260807 19:59:16.046353 29964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:16.047937 29964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:16.049165 29964 hybrid_clock.cc:648] HybridClock initialized: now 1786132756049053 us; error 82 us; skew 500 ppm
I20260807 19:59:16.049551 29964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:16 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132756, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:16.057523 29964 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:59:16.059149 29964 webserver.cc:460] Webserver started at http://127.5.197.190:39499/ using document root <none> and password file <none>
I20260807 19:59:16.059976 29964 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:16.060113 29964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:16.066177 29964 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:59:16.069082 29990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:16.070601 29964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:59:16.070828 29964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "41f9e3ccf7a4447eb508f35211430569"
format_stamp: "Formatted at 2026-08-07 19:58:52 on dist-test-slave-6bbx"
server_key: "8b2a74efce3a8432e6fa524ad9faeac8"
server_key_iv: "e80b30b11b95572aefd14731236f1822"
server_key_version: "encryptionkey@0"
I20260807 19:59:16.071962 29964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:16.088580 29964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:16.092752 29964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:16.093022 29964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:16.111147 29964 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37355
I20260807 19:59:16.111188 30068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37355 every 8 connection(s)
I20260807 19:59:16.112716 29964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:59:16.119918 30069 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:59:16.121066 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 29964
I20260807 19:59:16.122123 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:45263
--local_ip_for_outbound_sockets=127.5.197.129
--tserver_master_addrs=127.5.197.190:37355
--webserver_port=37751
--webserver_interface=127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:59:16.124393 30069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Bootstrap starting.
I20260807 19:59:16.146517 30069 log.cc:824] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:16.158989 30069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:59:16.159508 30069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Bootstrap complete.
I20260807 19:59:16.168654 30069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:16.169499 30069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9e3ccf7a4447eb508f35211430569, State: Initialized, Role: FOLLOWER
I20260807 19:59:16.170181 30069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:16.170414 30069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:59:16.170532 30069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:59:16.170692 30069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:59:16.174585 30069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:16.175107 30069 leader_election.cc:302] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41f9e3ccf7a4447eb508f35211430569; no voters:
I20260807 19:59:16.175813 30069 leader_election.cc:288] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:59:16.175956 30073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:59:16.178201 30069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:59:16.182493 30073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 LEADER]: Becoming Leader. State: Replica: 41f9e3ccf7a4447eb508f35211430569, State: Running, Role: LEADER
I20260807 19:59:16.183239 30073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:16.185911 30074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "41f9e3ccf7a4447eb508f35211430569" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } } }
I20260807 19:59:16.186324 30074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: This master's current role is: LEADER
I20260807 19:59:16.186841 30075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41f9e3ccf7a4447eb508f35211430569. Latest consensus state: current_term: 2 leader_uuid: "41f9e3ccf7a4447eb508f35211430569" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } } }
I20260807 19:59:16.187130 30075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: This master's current role is: LEADER
I20260807 19:59:16.188437 30088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:59:16.198110 30088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:59:16.199687 30088 catalog_manager.cc:1259] Loaded cluster ID: e75bb0b2cf18493eb8d2a40d2260f6df
I20260807 19:59:16.199844 30088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:59:16.204164 30088 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:59:16.205844 30088 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Loaded TSK: 0
I20260807 19:59:16.231720 30100 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 19:59:16.241174 30088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Generated new TSK 1
I20260807 19:59:16.241638 30088 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 19:59:16.488632 30071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:16.488929 30071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:16.489064 30071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:16.496301 30071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:16.496426 30071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:16.496578 30071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:59:16.506294 30071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:45263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=37751
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:16.507565 30071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:16.508944 30071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:16.523618 30111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:16.523916 30110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:16.524127 30113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:16.524510 30071 server_base.cc:1034] running on GCE node
I20260807 19:59:16.525142 30071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:16.526124 30071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:16.527347 30071 hybrid_clock.cc:648] HybridClock initialized: now 1786132756527303 us; error 44 us; skew 500 ppm
I20260807 19:59:16.527640 30071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:16 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132756, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:16.530732 30071 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:59:16.532284 30071 webserver.cc:460] Webserver started at http://127.5.197.129:37751/ using document root <none> and password file <none>
I20260807 19:59:16.532963 30071 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:16.533090 30071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:16.538472 30071 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 19:59:16.541177 30121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:16.542493 30071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:59:16.542644 30071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "f4e696e845094be08fbeda01f14e3f44"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "bff13906703ee817e7f1e23ac989f24d"
server_key_iv: "610972c8d1b6199b431f13181ef5d9b2"
server_key_version: "encryptionkey@0"
I20260807 19:59:16.543572 30071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:16.561561 30071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:16.565639 30071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:16.565889 30071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:16.566848 30071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:16.568210 30071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:16.568315 30071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:16.568413 30071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:16.568485 30071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:16.599854 30071 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:45263
I20260807 19:59:16.599951 30296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:45263 every 8 connection(s)
I20260807 19:59:16.601321 30071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:59:16.605942 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 30071
I20260807 19:59:16.606565 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:34457
--local_ip_for_outbound_sockets=127.5.197.130
--tserver_master_addrs=127.5.197.190:37355
--webserver_port=34595
--webserver_interface=127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:59:16 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132756, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:59:16.626052 30299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:16.604301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:58357 (local address 127.5.197.190:37355)
0807 19:59:16.604853 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:16.604865 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:16.605658 (+ 793us) server_negotiation.cc:407] Connection header received
0807 19:59:16.607915 (+ 2257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:16.607932 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:16.608366 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:16.608772 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:16.610120 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:16.611851 (+ 1731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:16.613381 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:16.614344 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:16.614501 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:16.618006 (+ 3505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:16.618017 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:16.618035 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:16.618077 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:16.621702 (+ 3625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:16.622605 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:16.622612 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:16.622617 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:16.622786 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:16.623273 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:16.623276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:16.623278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:16.623787 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:16.623958 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:16.624793 (+ 835us) server_negotiation.cc:299] Negotiation successful
0807 19:59:16.625125 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":241,"threads_started":1}
I20260807 19:59:16.626358 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:16.604551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:58357)
0807 19:59:16.605447 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:16.605504 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:16.607304 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:16.608877 (+ 1573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:16.608884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:16.609388 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:59:16.609922 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:16.609941 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:16.612009 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:16.612013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:16.613244 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:16.613258 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:16.614546 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:16.614551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:16.614744 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:16.615368 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:59:16.615390 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:59:16.617725 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:59:16.621845 (+ 4120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:16.621854 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:16.621869 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:16.622470 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:16.622935 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:16.622939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:16.622942 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:16.623175 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:16.623951 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:59:16.623958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:59:16.624346 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 19:59:16.624637 (+ 291us) client_negotiation.cc:240] Negotiation successful
0807 19:59:16.625193 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":339,"threads_started":1}
I20260807 19:59:16.629392 30297 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37355
I20260807 19:59:16.629679 30297 heartbeater.cc:464] Registering TS with master...
I20260807 19:59:16.630424 30297 heartbeater.cc:511] Master 127.5.197.190:37355 requested a full tablet report, sending...
I20260807 19:59:16.632789 30018 ts_manager.cc:194] Registered new tserver with Master: f4e696e845094be08fbeda01f14e3f44 (127.5.197.129:45263)
I20260807 19:59:16.634850 30018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:58357
W20260807 19:59:16.949018 30302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:16.949290 30302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:16.949393 30302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:16.956387 30302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:16.956493 30302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:16.956610 30302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:59:16.965909 30302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:34457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=34595
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:16.967094 30302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:16.968372 30302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:16.980746 30316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:16.980757 30314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:16.980859 30313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:16.981737 30302 server_base.cc:1034] running on GCE node
I20260807 19:59:16.982334 30302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:16.983202 30302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:16.984402 30302 hybrid_clock.cc:648] HybridClock initialized: now 1786132756984354 us; error 32 us; skew 500 ppm
I20260807 19:59:16.984736 30302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:16 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132756, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:16.987709 30302 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:59:16.989058 30302 webserver.cc:460] Webserver started at http://127.5.197.130:34595/ using document root <none> and password file <none>
I20260807 19:59:16.989707 30302 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:16.989846 30302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:16.994985 30302 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.001s
I20260807 19:59:16.997634 30323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:16.998888 30302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:59:16.999033 30302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "86591ec5540a4f42ab5029eb6e685d72"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "84eca2a4b07019af5dcaa9ecfb3023fc"
server_key_iv: "ba87566e36db5e081b35ff71642196a6"
server_key_version: "encryptionkey@0"
I20260807 19:59:17.000063 30302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:17.025969 30302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:17.029822 30302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:17.030071 30302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:17.031011 30302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:17.032321 30302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:17.032421 30302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:17.032521 30302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:17.032593 30302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:17.062690 30302 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:34457
I20260807 19:59:17.062759 30486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:34457 every 8 connection(s)
I20260807 19:59:17.064172 30302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:59:17.070580 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 30302
I20260807 19:59:17.071185 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:34995
--local_ip_for_outbound_sockets=127.5.197.131
--tserver_master_addrs=127.5.197.190:37355
--webserver_port=34593
--webserver_interface=127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:59:17 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132756, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:59:17.086222 30299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.066620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:52649 (local address 127.5.197.190:37355)
0807 19:59:17.066802 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.066807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.068038 (+ 1231us) server_negotiation.cc:407] Connection header received
0807 19:59:17.070171 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.070177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.070279 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.070395 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:17.071916 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.072900 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.074437 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.075012 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.075130 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.079685 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:17.079692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:17.079697 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:17.079739 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:17.082987 (+ 3248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.083858 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.083865 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.083868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.084020 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.084456 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.084460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.084462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.084827 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:17.084968 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.085654 (+ 686us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.085888 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:59:17.087258 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.067105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:52649)
0807 19:59:17.067878 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:17.067925 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:17.069906 (+ 1981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:17.070562 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:17.070570 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:17.071105 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:59:17.071749 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.071769 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.073047 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.073051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.074274 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.074290 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.075337 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.075348 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.075647 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.076467 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:59:17.076500 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:59:17.079358 (+ 2858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:59:17.083131 (+ 3773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:17.083139 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:17.083154 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:17.083723 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:17.084122 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:17.084126 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:17.084129 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:17.084359 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:17.084950 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:59:17.084955 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:59:17.085257 (+ 302us) client_negotiation.cc:769] Sending connection context
0807 19:59:17.085529 (+ 272us) client_negotiation.cc:240] Negotiation successful
0807 19:59:17.086091 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":267,"threads_started":1}
I20260807 19:59:17.088672 30488 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37355
I20260807 19:59:17.088968 30488 heartbeater.cc:464] Registering TS with master...
I20260807 19:59:17.089661 30488 heartbeater.cc:511] Master 127.5.197.190:37355 requested a full tablet report, sending...
I20260807 19:59:17.091094 30018 ts_manager.cc:194] Registered new tserver with Master: 86591ec5540a4f42ab5029eb6e685d72 (127.5.197.130:34457)
I20260807 19:59:17.092185 30018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:52649
W20260807 19:59:17.407446 30493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:17.407752 30493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:17.407863 30493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:17.414803 30493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:17.414896 30493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:17.415010 30493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:59:17.424435 30493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:34995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=34593
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:17.425676 30493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:17.427004 30493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:17.439903 30501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:17.439981 30502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:17.440002 30506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:17.441176 30493 server_base.cc:1034] running on GCE node
I20260807 19:59:17.441835 30493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:17.442823 30493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:17.444025 30493 hybrid_clock.cc:648] HybridClock initialized: now 1786132757443965 us; error 48 us; skew 500 ppm
I20260807 19:59:17.444410 30493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:17 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132757, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:17.447624 30493 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:59:17.449121 30493 webserver.cc:460] Webserver started at http://127.5.197.131:34593/ using document root <none> and password file <none>
I20260807 19:59:17.449810 30493 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:17.449947 30493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:17.455490 30493 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:59:17.458158 30520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:17.459422 30493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:59:17.459596 30493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "a83c10df283e490c8d29f54eba9928c3"
format_stamp: "Formatted at 2026-08-07 19:58:54 on dist-test-slave-6bbx"
server_key: "a4f9d2cbbabebfd49f8f1dca464ffa6c"
server_key_iv: "17c6c65857b824027d03b0fd8c75ba23"
server_key_version: "encryptionkey@0"
I20260807 19:59:17.460649 30493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:17.479854 30493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:17.483654 30493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:17.483932 30493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:17.484949 30493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:17.486291 30493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:17.486397 30493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:17.486514 30493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:17.486586 30493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:17.517212 30493 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:34995
I20260807 19:59:17.517266 30685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:34995 every 8 connection(s)
I20260807 19:59:17.518808 30493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:59:17.523028 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 30493
Aug 07 19:59:17 dist-test-slave-6bbx krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132757, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:59:17.538420 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.524007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36398 (local address 127.5.197.190:37355)
0807 19:59:17.524781 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.524786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.524821 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:59:17.524875 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.524879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.524941 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.525036 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:17.526753 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.527579 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.529103 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.529609 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.529738 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.532722 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:17.532729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:17.532733 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:17.532769 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:17.535762 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.536590 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.536596 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.536598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.536752 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.537131 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.537136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.537139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.537435 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:17.537682 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.537925 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.538095 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":663,"thread_start_us":549,"threads_started":1}
I20260807 19:59:17.539708 30299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.521337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:45887 (local address 127.5.197.190:37355)
0807 19:59:17.521510 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.521515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.522621 (+ 1106us) server_negotiation.cc:407] Connection header received
0807 19:59:17.524839 (+ 2218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.524844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.524916 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.524992 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:17.526481 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.527376 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.528990 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.529539 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.529630 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.533393 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:17.533400 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:17.533429 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:17.533465 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:17.536512 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.537288 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.537292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.537294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.537417 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.537888 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.537893 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.537896 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.538239 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:17.538394 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.539132 (+ 738us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.539348 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":60,"spinlock_wait_cycles":1408}
I20260807 19:59:17.540932 30691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.521747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:45887)
0807 19:59:17.522436 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:17.522480 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:17.524528 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:17.525261 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:17.525268 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:17.525756 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:59:17.526300 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.526318 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.527547 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.527553 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.528839 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.528852 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.529771 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.529778 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.530047 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.530716 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:59:17.530744 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:59:17.533171 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:59:17.536646 (+ 3475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:17.536653 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:17.536668 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:17.537163 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:17.537521 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:17.537525 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:17.537529 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:17.537758 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:17.538387 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:59:17.538396 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:59:17.538775 (+ 379us) client_negotiation.cc:769] Sending connection context
0807 19:59:17.539011 (+ 236us) client_negotiation.cc:240] Negotiation successful
0807 19:59:17.539513 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":252,"threads_started":1}
I20260807 19:59:17.542205 30688 heartbeater.cc:347] Connected to a master server at 127.5.197.190:37355
I20260807 19:59:17.542469 30688 heartbeater.cc:464] Registering TS with master...
I20260807 19:59:17.543118 30688 heartbeater.cc:511] Master 127.5.197.190:37355 requested a full tablet report, sending...
I20260807 19:59:17.544371 30018 ts_manager.cc:194] Registered new tserver with Master: a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995)
I20260807 19:59:17.545122 30018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:45887
I20260807 19:59:17.553210 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:59:17.559607 30299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.554080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36414 (local address 127.5.197.190:37355)
0807 19:59:17.554227 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.554233 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.554715 (+ 482us) server_negotiation.cc:407] Connection header received
0807 19:59:17.554930 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.554934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.555060 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.555179 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:59:17.555635 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.556390 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.557858 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.558253 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.558359 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.558825 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:59:17.559031 (+ 206us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 19:59:17.559370 (+ 339us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36414: token expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 19:59:17.559754 30299 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36414: token expired
W20260807 19:59:17.560271 29887 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.5.197.190:37355)
I20260807 19:59:17.572659 30299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.560684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36416 (local address 127.5.197.190:37355)
0807 19:59:17.560842 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.560846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.560861 (+ 15us) server_negotiation.cc:407] Connection header received
0807 19:59:17.560970 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.560973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.561034 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.561106 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:17.562530 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.563236 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.564617 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.565023 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.565132 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.567712 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:17.567719 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:17.567724 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:17.567753 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:17.570217 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.570907 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.570911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.570913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.571064 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.571422 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.571425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.571427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.571765 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:17.571961 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.572231 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.572402 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:59:17.576138 30018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36416:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:59:17.583396 30018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:59:17.619840 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.594999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:34457 (local address 127.0.0.1:56058)
0807 19:59:17.609583 (+ 14584us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:17.609627 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:17.609842 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:17.611526 (+ 1684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:17.611534 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:17.611569 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:17.611992 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.612004 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.614038 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.614043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.616528 (+ 2485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.616546 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.618750 (+ 2204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.618756 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.619075 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.619138 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 19:59:17.619257 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 19:59:17.619449 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14310,"thread_start_us":15030,"threads_started":1}
I20260807 19:59:17.620515 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.595183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56058 (local address 127.5.197.130:34457)
0807 19:59:17.610444 (+ 15261us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.610453 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.610487 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:59:17.610600 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.610609 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.610849 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.611051 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:17.612222 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.613866 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.616730 (+ 2864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.618263 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.618420 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.618625 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.620077 (+ 1452us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.620220 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15072,"thread_start_us":16075,"threads_started":1}
I20260807 19:59:17.624311 30391 tablet_service.cc:1467] Processing CreateTablet for tablet 135a142df2864bcb80a3afa5e03cd30b (DEFAULT_TABLE table=test-table [id=f65c643017be45aeb06a4eac15a8799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:59:17.625844 30391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 135a142df2864bcb80a3afa5e03cd30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:59:17.626927 30705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.596144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57752 (local address 127.5.197.129:45263)
0807 19:59:17.618709 (+ 22565us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.618718 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.619215 (+ 497us) server_negotiation.cc:407] Connection header received
0807 19:59:17.619443 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.619451 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.619640 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.619866 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:17.620885 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.622477 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.624849 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.625818 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.625943 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.626160 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.626458 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.626614 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22382,"thread_start_us":22227,"threads_started":1}
I20260807 19:59:17.627311 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.595090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:34995 (local address 127.0.0.1:51036)
0807 19:59:17.617158 (+ 22068us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:17.618176 (+ 1018us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:17.618840 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:17.619817 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:17.619825 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:17.619852 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:17.620290 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.620306 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.622216 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.622221 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.624508 (+ 2287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.624524 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.626555 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.626562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.626724 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.626755 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 19:59:17.626840 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 19:59:17.626974 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21917,"thread_start_us":23724,"threads_started":1}
I20260807 19:59:17.628026 30701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.596340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:45263 (local address 127.0.0.1:57752)
0807 19:59:17.619094 (+ 22754us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:17.619113 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:17.619242 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:17.619864 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:17.619868 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:17.619886 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:17.620536 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.620547 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.622659 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.622664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.624713 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.624724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.626122 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.626128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.626277 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.626301 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:59:17.626389 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 19:59:17.627656 (+ 1267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22613,"mutex_wait_us":1,"thread_start_us":20495,"threads_started":1}
I20260807 19:59:17.628101 30704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.595858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51036 (local address 127.5.197.131:34995)
0807 19:59:17.612203 (+ 16345us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.612212 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.618278 (+ 6066us) server_negotiation.cc:407] Connection header received
0807 19:59:17.619118 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.619130 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.619384 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.619516 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:17.620490 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.622028 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.624676 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.626021 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.626172 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.626405 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.627582 (+ 1177us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.627767 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16153,"thread_start_us":15993,"threads_started":1}
I20260807 19:59:17.630967 30582 tablet_service.cc:1467] Processing CreateTablet for tablet 135a142df2864bcb80a3afa5e03cd30b (DEFAULT_TABLE table=test-table [id=f65c643017be45aeb06a4eac15a8799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:59:17.631513 30200 tablet_service.cc:1467] Processing CreateTablet for tablet 135a142df2864bcb80a3afa5e03cd30b (DEFAULT_TABLE table=test-table [id=f65c643017be45aeb06a4eac15a8799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:59:17.632128 30582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 135a142df2864bcb80a3afa5e03cd30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:59:17.632958 30200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 135a142df2864bcb80a3afa5e03cd30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:59:17.638028 30297 heartbeater.cc:503] Master 127.5.197.190:37355 was elected leader, sending a full tablet report...
I20260807 19:59:17.642818 30707 tablet_bootstrap.cc:492] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Bootstrap starting.
I20260807 19:59:17.645437 30708 tablet_bootstrap.cc:492] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Bootstrap starting.
I20260807 19:59:17.646688 30707 tablet_bootstrap.cc:654] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Neither blocks nor log segments found. Creating new log.
I20260807 19:59:17.648335 30707 log.cc:824] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:17.648820 30711 tablet_bootstrap.cc:492] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Bootstrap starting.
I20260807 19:59:17.650012 30708 tablet_bootstrap.cc:654] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Neither blocks nor log segments found. Creating new log.
I20260807 19:59:17.650985 30708 log.cc:824] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:17.652462 30711 tablet_bootstrap.cc:654] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Neither blocks nor log segments found. Creating new log.
I20260807 19:59:17.653652 30711 log.cc:824] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:17.653883 30707 tablet_bootstrap.cc:492] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: No bootstrap required, opened a new log
I20260807 19:59:17.654114 30708 tablet_bootstrap.cc:492] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: No bootstrap required, opened a new log
I20260807 19:59:17.654143 30707 ts_tablet_manager.cc:1397] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 19:59:17.654412 30708 ts_tablet_manager.cc:1397] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260807 19:59:17.656785 30711 tablet_bootstrap.cc:492] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: No bootstrap required, opened a new log
I20260807 19:59:17.657045 30711 ts_tablet_manager.cc:1397] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 19:59:17.661927 30707 raft_consensus.cc:348] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.662308 30707 raft_consensus.cc:374] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:59:17.662405 30707 raft_consensus.cc:729] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86591ec5540a4f42ab5029eb6e685d72, State: Initialized, Role: FOLLOWER
I20260807 19:59:17.662971 30707 consensus_queue.cc:260] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.664170 30488 heartbeater.cc:503] Master 127.5.197.190:37355 was elected leader, sending a full tablet report...
I20260807 19:59:17.664743 30707 ts_tablet_manager.cc:1428] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Time spent starting tablet: real 0.010s user 0.011s sys 0.001s
I20260807 19:59:17.665923 30708 raft_consensus.cc:348] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.666332 30708 raft_consensus.cc:374] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:59:17.666440 30708 raft_consensus.cc:729] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83c10df283e490c8d29f54eba9928c3, State: Initialized, Role: FOLLOWER
I20260807 19:59:17.667035 30708 consensus_queue.cc:260] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.666988 30711 raft_consensus.cc:348] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.667382 30711 raft_consensus.cc:374] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:59:17.667490 30711 raft_consensus.cc:729] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4e696e845094be08fbeda01f14e3f44, State: Initialized, Role: FOLLOWER
I20260807 19:59:17.668134 30711 consensus_queue.cc:260] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.669879 30711 ts_tablet_manager.cc:1428] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260807 19:59:17.672495 30688 heartbeater.cc:503] Master 127.5.197.190:37355 was elected leader, sending a full tablet report...
I20260807 19:59:17.672885 30708 ts_tablet_manager.cc:1428] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Time spent starting tablet: real 0.018s user 0.017s sys 0.000s
I20260807 19:59:17.700464 30718 raft_consensus.cc:482] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:59:17.700733 30718 raft_consensus.cc:504] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.702392 30718 leader_election.cc:288] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86591ec5540a4f42ab5029eb6e685d72 (127.5.197.130:34457), a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995)
I20260807 19:59:17.710841 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.702880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:60047 (local address 127.5.197.130:34457)
0807 19:59:17.703054 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.703059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.703746 (+ 687us) server_negotiation.cc:407] Connection header received
0807 19:59:17.703975 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.703980 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.704059 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.704155 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:17.704933 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.706049 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.708844 (+ 2795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.710022 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.710175 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.710247 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.710526 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.710622 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:59:17.711166 30704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.702779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:41875 (local address 127.5.197.131:34995)
0807 19:59:17.703024 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.703031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.703847 (+ 816us) server_negotiation.cc:407] Connection header received
0807 19:59:17.703980 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.703985 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.704059 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.704155 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:17.704933 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.706046 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.709096 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.710297 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.710420 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.710483 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.710821 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.710948 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260807 19:59:17.711273 30722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.702817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:34995 (local address 127.5.197.129:41875)
0807 19:59:17.703745 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:17.703760 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:17.703860 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:17.704187 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:17.704192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:17.704223 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:17.704769 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.704778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.706170 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.706175 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.708680 (+ 2505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.708696 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.710503 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.710509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.710659 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.710688 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:59:17.710782 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 19:59:17.710898 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"mutex_wait_us":159,"thread_start_us":460,"threads_started":1}
I20260807 19:59:17.711512 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.702697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:34457 (local address 127.5.197.129:60047)
0807 19:59:17.703604 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:17.703624 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:17.703841 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:17.704187 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:17.704192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:17.704286 (+ 94us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:17.704764 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.704778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.706168 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.706173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.708685 (+ 2512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:17.708696 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.710210 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.710215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:17.710339 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.710372 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:59:17.710473 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 19:59:17.710606 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"mutex_wait_us":101,"spinlock_wait_cycles":22912,"thread_start_us":541,"threads_started":1}
I20260807 19:59:17.712272 30614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135a142df2864bcb80a3afa5e03cd30b" candidate_uuid: "f4e696e845094be08fbeda01f14e3f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83c10df283e490c8d29f54eba9928c3" is_pre_election: true
I20260807 19:59:17.712538 30420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135a142df2864bcb80a3afa5e03cd30b" candidate_uuid: "f4e696e845094be08fbeda01f14e3f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86591ec5540a4f42ab5029eb6e685d72" is_pre_election: true
I20260807 19:59:17.712855 30614 raft_consensus.cc:2454] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4e696e845094be08fbeda01f14e3f44 in term 0.
I20260807 19:59:17.713045 30420 raft_consensus.cc:2454] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4e696e845094be08fbeda01f14e3f44 in term 0.
I20260807 19:59:17.713548 30128 leader_election.cc:302] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a83c10df283e490c8d29f54eba9928c3, f4e696e845094be08fbeda01f14e3f44; no voters:
I20260807 19:59:17.713914 30718 raft_consensus.cc:2781] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:59:17.714037 30718 raft_consensus.cc:482] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:59:17.714131 30718 raft_consensus.cc:3037] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:59:17.716382 30718 raft_consensus.cc:504] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.716984 30718 leader_election.cc:288] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [CANDIDATE]: Term 1 election: Requested vote from peers 86591ec5540a4f42ab5029eb6e685d72 (127.5.197.130:34457), a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995)
I20260807 19:59:17.717339 30420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135a142df2864bcb80a3afa5e03cd30b" candidate_uuid: "f4e696e845094be08fbeda01f14e3f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86591ec5540a4f42ab5029eb6e685d72"
I20260807 19:59:17.717463 30614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "135a142df2864bcb80a3afa5e03cd30b" candidate_uuid: "f4e696e845094be08fbeda01f14e3f44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83c10df283e490c8d29f54eba9928c3"
I20260807 19:59:17.717555 30420 raft_consensus.cc:3037] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:59:17.717712 30614 raft_consensus.cc:3037] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:59:17.720772 30420 raft_consensus.cc:2454] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4e696e845094be08fbeda01f14e3f44 in term 1.
I20260807 19:59:17.720777 30614 raft_consensus.cc:2454] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4e696e845094be08fbeda01f14e3f44 in term 1.
I20260807 19:59:17.721191 30123 leader_election.cc:302] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 86591ec5540a4f42ab5029eb6e685d72, a83c10df283e490c8d29f54eba9928c3, f4e696e845094be08fbeda01f14e3f44; no voters:
I20260807 19:59:17.721511 30718 raft_consensus.cc:2781] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:59:17.721925 30718 raft_consensus.cc:686] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 1 LEADER]: Becoming Leader. State: Replica: f4e696e845094be08fbeda01f14e3f44, State: Running, Role: LEADER
I20260807 19:59:17.722397 30718 consensus_queue.cc:237] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } }
I20260807 19:59:17.726773 30018 catalog_manager.cc:5495] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4e696e845094be08fbeda01f14e3f44 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "f4e696e845094be08fbeda01f14e3f44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4e696e845094be08fbeda01f14e3f44" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 45263 } health_report { overall_health: HEALTHY } } }
I20260807 19:59:17.744791 30705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.739604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40696 (local address 127.5.197.129:45263)
0807 19:59:17.739819 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.739824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.739891 (+ 67us) server_negotiation.cc:407] Connection header received
0807 19:59:17.740064 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.740067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.740154 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.740278 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:59:17.740564 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.741327 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.742742 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.743163 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.743250 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.743755 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:59:17.744279 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:59:17.744391 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.744523 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.744589 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 19:59:17.753127 30614 raft_consensus.cc:1261] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Refusing update from remote peer f4e696e845094be08fbeda01f14e3f44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:59:17.753129 30420 raft_consensus.cc:1261] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 1 FOLLOWER]: Refusing update from remote peer f4e696e845094be08fbeda01f14e3f44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:59:17.754032 30723 consensus_queue.cc:1035] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83c10df283e490c8d29f54eba9928c3" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 34995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:59:17.754391 30718 consensus_queue.cc:1035] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86591ec5540a4f42ab5029eb6e685d72" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 34457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:59:17.778908 30017 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:59:17.779249 30017 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:59:17.783164 30017 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Sending DeleteTablet for 3 replicas of tablet 135a142df2864bcb80a3afa5e03cd30b
I20260807 19:59:17.784377 30391 tablet_service.cc:1514] Processing DeleteTablet for tablet 135a142df2864bcb80a3afa5e03cd30b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:59:17 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:56058
I20260807 19:59:17.784536 30582 tablet_service.cc:1514] Processing DeleteTablet for tablet 135a142df2864bcb80a3afa5e03cd30b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:59:17 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:51036
I20260807 19:59:17.785559 30736 tablet_replica.cc:330] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: stopping tablet replica
I20260807 19:59:17.785741 30200 tablet_service.cc:1514] Processing DeleteTablet for tablet 135a142df2864bcb80a3afa5e03cd30b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:59:17 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:57752
I20260807 19:59:17.786123 30736 raft_consensus.cc:2229] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:59:17.786355 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 30071
I20260807 19:59:17.786746 30736 raft_consensus.cc:2258] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:59:17.787614 30738 tablet_replica.cc:330] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: stopping tablet replica
I20260807 19:59:17.788081 30738 raft_consensus.cc:2229] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:59:17.788851 30738 raft_consensus.cc:2258] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:59:17.789049 30736 ts_tablet_manager.cc:1905] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:59:17.792284 30737 tablet_replica.cc:330] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: stopping tablet replica
I20260807 19:59:17.792724 30737 raft_consensus.cc:2229] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:59:17.794798 30738 ts_tablet_manager.cc:1905] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:59:17.796053 30736 ts_tablet_manager.cc:1918] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:59:17.796228 30736 log.cc:1196] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/135a142df2864bcb80a3afa5e03cd30b
I20260807 19:59:17.796833 30736 ts_tablet_manager.cc:1939] T 135a142df2864bcb80a3afa5e03cd30b P 86591ec5540a4f42ab5029eb6e685d72: Deleting consensus metadata
I20260807 19:59:17.798797 29992 catalog_manager.cc:4841] TS 86591ec5540a4f42ab5029eb6e685d72 (127.5.197.130:34457): tablet 135a142df2864bcb80a3afa5e03cd30b (table test-table [id=f65c643017be45aeb06a4eac15a8799e]) successfully deleted
I20260807 19:59:17.793288 30737 raft_consensus.cc:2258] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:59:17.801317 30737 ts_tablet_manager.cc:1905] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:59:17.803638 30738 ts_tablet_manager.cc:1918] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:59:17.803876 30738 log.cc:1196] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/135a142df2864bcb80a3afa5e03cd30b
I20260807 19:59:17.804589 30738 ts_tablet_manager.cc:1939] T 135a142df2864bcb80a3afa5e03cd30b P f4e696e845094be08fbeda01f14e3f44: Deleting consensus metadata
I20260807 19:59:17.806355 29996 catalog_manager.cc:4841] TS f4e696e845094be08fbeda01f14e3f44 (127.5.197.129:45263): tablet 135a142df2864bcb80a3afa5e03cd30b (table test-table [id=f65c643017be45aeb06a4eac15a8799e]) successfully deleted
I20260807 19:59:17.807169 30705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.787810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40704 (local address 127.5.197.129:45263)
0807 19:59:17.787967 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.787972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.787992 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:59:17.788150 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.788157 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.788244 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.788364 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:17.790310 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.791407 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.793724 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.794434 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.794568 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.798221 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:17.798234 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:17.798251 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:17.798304 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:17.802822 (+ 4518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.803762 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.803770 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.803773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.803972 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.804433 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.804442 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.804446 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.804937 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:17.806388 (+ 1451us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.806551 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.806805 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:59:17.807843 30292 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:17.808276 30737 ts_tablet_manager.cc:1918] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:59:17.808449 30737 log.cc:1196] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/135a142df2864bcb80a3afa5e03cd30b
I20260807 19:59:17.808969 30737 ts_tablet_manager.cc:1939] T 135a142df2864bcb80a3afa5e03cd30b P a83c10df283e490c8d29f54eba9928c3: Deleting consensus metadata
I20260807 19:59:17.810809 29997 catalog_manager.cc:4841] TS a83c10df283e490c8d29f54eba9928c3 (127.5.197.131:34995): tablet 135a142df2864bcb80a3afa5e03cd30b (table test-table [id=f65c643017be45aeb06a4eac15a8799e]) successfully deleted
I20260807 19:59:17.905229 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 30071
I20260807 19:59:17.933229 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 30302
I20260807 19:59:17.946825 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:17.934164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42468 (local address 127.5.197.130:34457)
0807 19:59:17.934333 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:17.934338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:17.934356 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:59:17.934481 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:17.934485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:17.934564 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:17.934645 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:17.936033 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.936816 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.938118 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:17.938533 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:17.938631 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:17.941496 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:17.941513 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:17.941530 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:17.941567 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:17.944232 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.944873 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.944880 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.944882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.945005 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:17.945400 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:17.945405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:17.945407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:17.945818 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:17.946057 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:17.946312 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 19:59:17.946483 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:59:17.947528 30479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:18.034808 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 30302
I20260807 19:59:18.053786 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 30493
I20260807 19:59:18.067386 30704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:18.054512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40016 (local address 127.5.197.131:34995)
0807 19:59:18.054693 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:18.054699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:18.054719 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:59:18.054915 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:18.054919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:18.054985 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:18.055072 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:18.056551 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:18.057280 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:18.058604 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:18.059014 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:18.059123 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:18.061677 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:18.061691 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:18.061709 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:18.061747 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:18.064479 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:18.065269 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:18.065280 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:18.065283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:18.065470 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:18.065833 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:18.065838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:18.065842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:18.066276 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:18.066548 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:18.066849 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 19:59:18.067062 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:59:18.068270 30680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:18.157028 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 30493
I20260807 19:59:18.180887 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 29964
I20260807 19:59:18.182165 30062 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:18.300451 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 29964
I20260807 19:59:38.329128 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37355
--webserver_interface=127.5.197.190
--webserver_port=39499
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:37355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:59:38.669734 30745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:38.670013 30745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:38.670101 30745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:38.677534 30745 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 19:59:38.677624 30745 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 19:59:38.677668 30745 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 19:59:38.677718 30745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:59:38.677769 30745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:38.677836 30745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:38.677879 30745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:59:38.677935 30745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:59:38.687456 30745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:37355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:37355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=39499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:38.688654 30745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:38.689954 30745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:38.701233 30752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:38.701366 30753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:38.701336 30759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:38.702226 30745 server_base.cc:1034] running on GCE node
I20260807 19:59:38.702982 30745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:38.704306 30745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:38.705509 30745 hybrid_clock.cc:648] HybridClock initialized: now 1786132778705440 us; error 44 us; skew 500 ppm
I20260807 19:59:38.705790 30745 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:38 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132778, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:38.711740 30745 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:59:38.713141 30745 webserver.cc:460] Webserver started at http://127.5.197.190:39499/ using document root <none> and password file <none>
I20260807 19:59:38.713780 30745 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:38.713868 30745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:38.719376 30745 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:59:38.722267 30770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:38.723497 30745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:59:38.723644 30745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "41f9e3ccf7a4447eb508f35211430569"
format_stamp: "Formatted at 2026-08-07 19:58:52 on dist-test-slave-6bbx"
server_key: "8b2a74efce3a8432e6fa524ad9faeac8"
server_key_iv: "e80b30b11b95572aefd14731236f1822"
server_key_version: "encryptionkey@0"
I20260807 19:59:38.724598 30745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:38.751543 30745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:38.755842 30745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:38.756117 30745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:38.773916 30745 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:37355
I20260807 19:59:38.773939 30840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:37355 every 8 connection(s)
I20260807 19:59:38.775372 30745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:59:38.780201 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 30745
I20260807 19:59:38.781014 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:45263
--local_ip_for_outbound_sockets=127.5.197.129
--tserver_master_addrs=127.5.197.190:37355
--webserver_port=37751
--webserver_interface=127.5.197.129
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:59:38.782347 30841 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:59:38.785545 30841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Bootstrap starting.
I20260807 19:59:38.806782 30841 log.cc:824] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:38.824295 30841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:59:38.824790 30841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Bootstrap complete.
I20260807 19:59:38.833920 30841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:38.834798 30841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f9e3ccf7a4447eb508f35211430569, State: Initialized, Role: FOLLOWER
I20260807 19:59:38.835402 30841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:38.835614 30841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:59:38.835767 30841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:59:38.835935 30841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 2 FOLLOWER]: Advancing to term 3
I20260807 19:59:38.839617 30841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:38.840114 30841 leader_election.cc:302] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41f9e3ccf7a4447eb508f35211430569; no voters:
I20260807 19:59:38.840745 30841 leader_election.cc:288] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 19:59:38.840899 30847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 19:59:38.841996 30847 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [term 3 LEADER]: Becoming Leader. State: Replica: 41f9e3ccf7a4447eb508f35211430569, State: Running, Role: LEADER
I20260807 19:59:38.842600 30847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } }
I20260807 19:59:38.842885 30841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:59:38.845079 30849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41f9e3ccf7a4447eb508f35211430569. Latest consensus state: current_term: 3 leader_uuid: "41f9e3ccf7a4447eb508f35211430569" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } } }
I20260807 19:59:38.845467 30849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: This master's current role is: LEADER
I20260807 19:59:38.846140 30848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "41f9e3ccf7a4447eb508f35211430569" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41f9e3ccf7a4447eb508f35211430569" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 37355 } } }
I20260807 19:59:38.846503 30848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569 [sys.catalog]: This master's current role is: LEADER
I20260807 19:59:38.846591 30853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:59:38.863291 30853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:59:38.864816 30853 catalog_manager.cc:1259] Loaded cluster ID: e75bb0b2cf18493eb8d2a40d2260f6df
I20260807 19:59:38.864995 30853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:59:38.869261 30853 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:59:38.871300 30853 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Loaded TSK: 0
I20260807 19:59:38.871516 30853 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 41f9e3ccf7a4447eb508f35211430569: Loaded TSK: 1
F20260807 19:59:38.872820 30853 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f29edac69ad google::LogMessage::Fail() at ??:0
@ 0x7f29edac988a google::LogMessage::SendToLog() at ??:0
@ 0x7f29edac64de google::LogMessage::Flush() at ??:0
@ 0x7f29edac7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f29f182a7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f29f181973e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f2a034f51c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2a034f4783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f2a035802a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f2a035800c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f2a035ca5e9 std::function<>::operator()() at ??:0
@ 0x7f2a034f8cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f2a034f6c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2a0357e610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f2a0357e439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f29f0712345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f29f071591c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f29f0715799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f29f06f0eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f29f39ca6db start_thread at ??:0
@ 0x7f29ec96061f clone at ??:0
W20260807 19:59:39.180320 30845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:39.180612 30845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:39.180738 30845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:39.188159 30845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:39.188278 30845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:39.188426 30845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:59:39.198756 30845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:45263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=37751
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:39.200560 30845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:39.201869 30845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:39.214833 30906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:39.214874 30908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:39.214797 30911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:39.215559 30845 server_base.cc:1034] running on GCE node
I20260807 19:59:39.216145 30845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:39.217031 30845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:39.218276 30845 hybrid_clock.cc:648] HybridClock initialized: now 1786132779218222 us; error 37 us; skew 500 ppm
I20260807 19:59:39.218583 30845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:39 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132779, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:39.221679 30845 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:59:39.223095 30845 webserver.cc:460] Webserver started at http://127.5.197.129:37751/ using document root <none> and password file <none>
I20260807 19:59:39.223775 30845 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:39.223888 30845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:39.229081 30845 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 19:59:39.231913 30922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:39.233217 30845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:59:39.233377 30845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "f4e696e845094be08fbeda01f14e3f44"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "bff13906703ee817e7f1e23ac989f24d"
server_key_iv: "610972c8d1b6199b431f13181ef5d9b2"
server_key_version: "encryptionkey@0"
I20260807 19:59:39.234385 30845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:39.255232 30845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:39.259593 30845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:39.259873 30845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:39.260887 30845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:39.262269 30845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:39.262367 30845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:39.262475 30845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:39.262554 30845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:39.295397 30845 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:45263
I20260807 19:59:39.295459 31080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:45263 every 8 connection(s)
I20260807 19:59:39.296859 30845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:59:39.299886 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 30845
I20260807 19:59:39.300629 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:34457
--local_ip_for_outbound_sockets=127.5.197.130
--tserver_master_addrs=127.5.197.190:37355
--webserver_port=34595
--webserver_interface=127.5.197.130
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:59:39.302080 31083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:39.299795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:43741)
0807 19:59:39.300643 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:39.300980 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":296,"threads_started":1}
W20260807 19:59:39.302817 31081 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:37355 (0 consecutive failures): Network error: Failed to ping master at 127.5.197.190:37355: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
I20260807 19:59:39.303699 31083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:39.303318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:36079)
0807 19:59:39.303473 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:39.303555 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 19:59:39.305008 31083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:39.304377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:51589)
0807 19:59:39.304726 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:39.304821 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253}
W20260807 19:59:39.305245 31081 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:59:39.640259 31084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:39.640522 31084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:39.640654 31084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:39.647691 31084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:39.647786 31084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:39.647928 31084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:59:39.657155 31084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:34457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=34595
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:39.658350 31084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:39.659612 31084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:39.672147 31092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:39.672147 31091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:39.672260 31094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:39.673002 31084 server_base.cc:1034] running on GCE node
I20260807 19:59:39.673583 31084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:39.674451 31084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:39.675696 31084 hybrid_clock.cc:648] HybridClock initialized: now 1786132779675627 us; error 32 us; skew 500 ppm
I20260807 19:59:39.676012 31084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:39 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132779, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:39.679071 31084 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:59:39.680555 31084 webserver.cc:460] Webserver started at http://127.5.197.130:34595/ using document root <none> and password file <none>
I20260807 19:59:39.681208 31084 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:39.681332 31084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:39.686568 31084 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 19:59:39.689169 31101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:39.690466 31084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:59:39.690629 31084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "86591ec5540a4f42ab5029eb6e685d72"
format_stamp: "Formatted at 2026-08-07 19:58:53 on dist-test-slave-6bbx"
server_key: "84eca2a4b07019af5dcaa9ecfb3023fc"
server_key_iv: "ba87566e36db5e081b35ff71642196a6"
server_key_version: "encryptionkey@0"
I20260807 19:59:39.691555 31084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:39.704000 31084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:39.707613 31084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:39.707880 31084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:39.708772 31084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:39.710028 31084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:39.710131 31084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:39.710239 31084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:39.710310 31084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:39.740670 31084 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:34457
I20260807 19:59:39.740738 31262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:34457 every 8 connection(s)
I20260807 19:59:39.742084 31084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:59:39.746712 31267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:39.744960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:36519)
0807 19:59:39.745679 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:39.745905 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":281,"threads_started":1}
W20260807 19:59:39.747430 31263 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:37355 (0 consecutive failures): Network error: Failed to ping master at 127.5.197.190:37355: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
I20260807 19:59:39.748193 31267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:39.747885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:43993)
0807 19:59:39.748029 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:39.748092 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 19:59:39.748957 31267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:39.748654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:59713)
0807 19:59:39.748783 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:39.748854 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 19:59:39.749182 31263 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:59:39.751571 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 31084
I20260807 19:59:39.752158 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:34995
--local_ip_for_outbound_sockets=127.5.197.131
--tserver_master_addrs=127.5.197.190:37355
--webserver_port=34593
--webserver_interface=127.5.197.131
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:59:40.090268 31268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:40.090545 31268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:40.090677 31268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:40.097806 31268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:40.097920 31268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:40.098081 31268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:59:40.107815 31268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:34995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=34593
--tserver_master_addrs=127.5.197.190:37355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:40.109043 31268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:40.110428 31268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:40.123373 31274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:40.123445 31276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:40.123466 31279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:40.124274 31268 server_base.cc:1034] running on GCE node
I20260807 19:59:40.124869 31268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:40.125754 31268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:40.126956 31268 hybrid_clock.cc:648] HybridClock initialized: now 1786132780126908 us; error 38 us; skew 500 ppm
I20260807 19:59:40.127262 31268 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:40 dist-test-slave-6bbx krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132780, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:40.130262 31268 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:59:40.131693 31268 webserver.cc:460] Webserver started at http://127.5.197.131:34593/ using document root <none> and password file <none>
I20260807 19:59:40.132380 31268 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:40.132501 31268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:40.137780 31268 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 19:59:40.140538 31286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:40.141857 31268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:59:40.142019 31268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "a83c10df283e490c8d29f54eba9928c3"
format_stamp: "Formatted at 2026-08-07 19:58:54 on dist-test-slave-6bbx"
server_key: "a4f9d2cbbabebfd49f8f1dca464ffa6c"
server_key_iv: "17c6c65857b824027d03b0fd8c75ba23"
server_key_version: "encryptionkey@0"
I20260807 19:59:40.143024 31268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:40.158491 31268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:40.162305 31268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:40.162557 31268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:40.163518 31268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:40.164873 31268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:40.164979 31268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:40.165084 31268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:40.165159 31268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:40.196691 31268 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:34995
I20260807 19:59:40.196769 31439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:34995 every 8 connection(s)
I20260807 19:59:40.198154 31268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:59:40.202287 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 31268
I20260807 19:59:40.202921 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:40.201023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:48545)
0807 19:59:40.201754 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:40.202024 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":282,"threads_started":1}
W20260807 19:59:40.203684 31440 heartbeater.cc:644] Failed to heartbeat to 127.5.197.190:37355 (0 consecutive failures): Network error: Failed to ping master at 127.5.197.190:37355: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
I20260807 19:59:40.204521 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:40.204198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:34787)
0807 19:59:40.204339 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:40.204410 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 19:59:40.205267 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:40.204980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:44951)
0807 19:59:40.205084 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:40.205161 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 19:59:40.205479 31440 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:59:40.306488 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:40.305695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:39723)
0807 19:59:40.306171 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:40.306256 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":248,"threads_started":1}
I20260807 19:59:40.750516 31449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:40.749678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:34489)
0807 19:59:40.750190 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:40.750280 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":241,"threads_started":1}
I20260807 19:59:41.206811 31450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:41.206016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:34405)
0807 19:59:41.206486 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:41.206593 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":231,"threads_started":1}
I20260807 19:59:41.308061 31451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:41.307307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:47191)
0807 19:59:41.307808 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:41.307890 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":241,"threads_started":1}
I20260807 19:59:41.752112 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:41.751333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:37809)
0807 19:59:41.751866 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:41.751949 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":243,"threads_started":1}
I20260807 19:59:42.208447 31454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:42.207686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:36857)
0807 19:59:42.208175 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:42.208257 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":250,"threads_started":1}
I20260807 19:59:42.309682 31455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:42.308875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:56305)
0807 19:59:42.309374 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:42.309483 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":230,"threads_started":1}
I20260807 19:59:42.753681 31457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:42.752972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:47185)
0807 19:59:42.753430 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:42.753513 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":258,"threads_started":1}
I20260807 19:59:43.209996 31459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:43.209219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:46779)
0807 19:59:43.209722 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:43.209813 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":274,"threads_started":1}
I20260807 19:59:43.311357 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:43.310646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:43007)
0807 19:59:43.311078 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:43.311157 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":209,"threads_started":1}
I20260807 19:59:43.755216 31462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:43.754474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:54303)
0807 19:59:43.754938 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:43.755018 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":214,"threads_started":1}
I20260807 19:59:44.211783 31463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:44.210906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:51371)
0807 19:59:44.211428 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:44.211512 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":255,"threads_started":1}
I20260807 19:59:44.312933 31465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:44.312230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:52665)
0807 19:59:44.312663 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:44.312762 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":216,"threads_started":1}
I20260807 19:59:44.756795 31466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:44.756066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:37971)
0807 19:59:44.756535 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:44.756626 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":243,"threads_started":1}
I20260807 19:59:45.213358 31468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:45.212632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:35391)
0807 19:59:45.213107 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:45.213186 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":246,"threads_started":1}
I20260807 19:59:45.316001 31469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:45.314383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:52791)
0807 19:59:45.315373 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:45.315542 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":489,"threads_started":1}
I20260807 19:59:45.759130 31472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:45.757953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:33277)
0807 19:59:45.758700 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:45.758853 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":362,"threads_started":1}
I20260807 19:59:46.216796 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:46.214944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:39647)
0807 19:59:46.216187 (+ 1243us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:46.216458 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":898,"thread_start_us":547,"threads_started":1}
I20260807 19:59:46.318847 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:46.317402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:41759)
0807 19:59:46.318325 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:46.318485 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":340,"threads_started":1}
I20260807 19:59:46.761020 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:46.760177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:55101)
0807 19:59:46.760701 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:46.760804 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":225,"threads_started":1}
I20260807 19:59:47.218842 31478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:47.217954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:42575)
0807 19:59:47.218521 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:47.218608 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":283,"threads_started":1}
I20260807 19:59:47.320657 31479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:47.319952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:56101)
0807 19:59:47.320411 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:47.320495 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":217,"threads_started":1}
I20260807 19:59:47.762573 31482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:47.761860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:37811)
0807 19:59:47.762325 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:47.762406 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":209,"threads_started":1}
I20260807 19:59:48.220495 31484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:48.219774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:39785)
0807 19:59:48.220241 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:48.220325 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":235,"threads_started":1}
I20260807 19:59:48.322363 31485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:48.321565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:55637)
0807 19:59:48.322075 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:48.322176 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":255,"threads_started":1}
I20260807 19:59:48.765004 31486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:48.764113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:56495)
0807 19:59:48.764686 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:48.764799 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"threads_started":1}
I20260807 19:59:49.222173 31487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:49.221431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:48423)
0807 19:59:49.221897 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:49.221979 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":220,"threads_started":1}
I20260807 19:59:49.324012 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:49.323254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:54469)
0807 19:59:49.323756 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:49.323845 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":241,"threads_started":1}
I20260807 19:59:49.769366 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:49.768619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:34729)
0807 19:59:49.769108 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:49.769200 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":266,"threads_started":1}
I20260807 19:59:50.223853 31490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:50.223070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:44677)
0807 19:59:50.223573 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:50.223679 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":291,"threads_started":1}
I20260807 19:59:50.325711 31494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:50.324926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:46901)
0807 19:59:50.325417 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:50.325523 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":265,"threads_started":1}
I20260807 19:59:50.771152 31496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:50.770287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:34641)
0807 19:59:50.770835 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:50.770930 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":257,"threads_started":1}
I20260807 19:59:51.225454 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:51.224746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:37563)
0807 19:59:51.225169 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:51.225277 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":208,"threads_started":1}
I20260807 19:59:51.327432 31498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:51.326687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:34443)
0807 19:59:51.327155 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:51.327250 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":244,"threads_started":1}
I20260807 19:59:51.772832 31499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:51.772072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:48407)
0807 19:59:51.772540 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:51.772637 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":236,"threads_started":1}
I20260807 19:59:52.227129 31501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:52.226400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:40925)
0807 19:59:52.226876 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:52.226964 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":247,"threads_started":1}
I20260807 19:59:52.329190 31502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:52.328408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:43653)
0807 19:59:52.328906 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:52.329000 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":239,"threads_started":1}
I20260807 19:59:52.774541 31503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:52.773670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:42975)
0807 19:59:52.774193 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:52.774353 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":270,"threads_started":1}
I20260807 19:59:53.228960 31505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:53.228059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:40131)
0807 19:59:53.228629 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:53.228755 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":310,"threads_started":1}
I20260807 19:59:53.330806 31506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:53.330053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:56963)
0807 19:59:53.330527 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:53.330614 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":251,"threads_started":1}
I20260807 19:59:53.776332 31508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:53.775387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:47909)
0807 19:59:53.775943 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:53.776031 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":298,"threads_started":1}
I20260807 19:59:54.230587 31509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:54.229859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:51231)
0807 19:59:54.230304 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:54.230401 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":217,"threads_started":1}
I20260807 19:59:54.332634 31512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:54.331916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.129:40903)
0807 19:59:54.332345 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:54.332451 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":219,"threads_started":1}
I20260807 19:59:54.778303 31513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:54.777474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.130:57371)
0807 19:59:54.778014 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:54.778106 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":276,"threads_started":1}
I20260807 19:59:55.204968 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 30845
I20260807 19:59:55.227023 31514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:55.206155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55096 (local address 127.5.197.129:45263)
0807 19:59:55.206846 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:55.206869 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:55.206928 (+ 59us) server_negotiation.cc:407] Connection header received
0807 19:59:55.208596 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:55.208606 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:55.209046 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:55.209350 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:55.210859 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:55.212201 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:55.213486 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:55.214196 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:55.214342 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:55.221148 (+ 6806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:55.221159 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:55.221180 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:55.221224 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:55.224165 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:55.224823 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:55.224829 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:55.224835 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:55.225007 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:55.225296 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:55.225299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:55.225301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:55.225816 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:55.226043 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:55.226389 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 19:59:55.226742 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":275,"threads_started":1}
I20260807 19:59:55.228463 31076 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:55.232722 31516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:55.231753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:37355 (local address 127.5.197.131:42537)
0807 19:59:55.232388 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:55.232513 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.190:37355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":253,"threads_started":1}
I20260807 19:59:55.314756 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 30845
I20260807 19:59:55.345314 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 31084
I20260807 19:59:55.363433 31517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:55.346382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45516 (local address 127.5.197.130:34457)
0807 19:59:55.347011 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:55.347027 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:55.347073 (+ 46us) server_negotiation.cc:407] Connection header received
0807 19:59:55.348795 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:55.348805 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:55.349240 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:55.349569 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:55.350930 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:55.352361 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:55.353636 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:55.354296 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:55.354437 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:55.356912 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:55.356919 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:55.356934 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:55.356969 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:55.360592 (+ 3623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:55.361237 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:55.361243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:55.361249 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:55.361419 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:55.361709 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:55.361712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:55.361714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:55.362221 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:55.362458 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:55.362750 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 19:59:55.363141 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":312,"threads_started":1}
I20260807 19:59:55.364809 31256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:55.448529 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 31084
I20260807 19:59:55.473482 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 31268
I20260807 19:59:55.490971 31519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:55.474512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43622 (local address 127.5.197.131:34995)
0807 19:59:55.475106 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:55.475121 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:55.475203 (+ 82us) server_negotiation.cc:407] Connection header received
0807 19:59:55.477016 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:55.477025 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:55.477504 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:55.477801 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:55.479128 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:55.480561 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:55.481819 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:55.482504 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:55.482641 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:55.485198 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:55.485205 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:55.485220 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:55.485263 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:55.488158 (+ 2895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:55.488779 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:55.488785 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:55.488790 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:55.488960 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:55.489259 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:55.489262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:55.489264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:55.489774 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:55.490008 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:55.490277 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 19:59:55.490666 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":256,"threads_started":1}
I20260807 19:59:55.492383 31435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:55.576895 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 31268
2026-08-07T19:59:55Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64549 ms)
[----------] 30 tests from SecurityITest (304135 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:59:55 dist-test-slave-6bbx krb5kdc[31526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:59:55 dist-test-slave-6bbx krb5kdc[31526](info): set up 2 sockets
Aug 07 19:59:55 dist-test-slave-6bbx krb5kdc[31526](info): commencing operation
krb5kdc: starting...
W20260807 19:59:56.790525 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 19:59:56 dist-test-slave-6bbx krb5kdc[31526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:59:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:59:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 19:59:57.080782 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:35979
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:40637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:35979
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:59:57.416739 31542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:57.417014 31542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:57.417147 31542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:57.424168 31542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:59:57.424273 31542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:57.424345 31542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:57.424428 31542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:59:57.424485 31542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:59:57.434012 31542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:40637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:35979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:35979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:57.435269 31542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:57.436599 31542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:57.448115 31554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:57.448307 31551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:57.448334 31549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:57.449045 31542 server_base.cc:1034] running on GCE node
I20260807 19:59:57.449795 31542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:57.451118 31542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:57.452313 31542 hybrid_clock.cc:648] HybridClock initialized: now 1786132797452267 us; error 38 us; skew 500 ppm
I20260807 19:59:57.452636 31542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:57 dist-test-slave-6bbx krb5kdc[31526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132797, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:57.455595 31542 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 19:59:57.457041 31542 webserver.cc:460] Webserver started at http://127.5.197.190:41089/ using document root <none> and password file <none>
I20260807 19:59:57.457686 31542 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:57.457801 31542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:57.458096 31542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:59:57.461014 31542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "b55d9608b89546af89cd9cee022abd79"
format_stamp: "Formatted at 2026-08-07 19:59:57 on dist-test-slave-6bbx"
server_key: "f8e149784550c985b7531c37a935262f"
server_key_iv: "8df141f3faf28f0270f987e0f7aa28ac"
server_key_version: "encryptionkey@0"
I20260807 19:59:57.461740 31542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "b55d9608b89546af89cd9cee022abd79"
format_stamp: "Formatted at 2026-08-07 19:59:57 on dist-test-slave-6bbx"
server_key: "f8e149784550c985b7531c37a935262f"
server_key_iv: "8df141f3faf28f0270f987e0f7aa28ac"
server_key_version: "encryptionkey@0"
I20260807 19:59:57.466583 31542 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 19:59:57.469921 31567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:57.471211 31542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 19:59:57.471364 31542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "b55d9608b89546af89cd9cee022abd79"
format_stamp: "Formatted at 2026-08-07 19:59:57 on dist-test-slave-6bbx"
server_key: "f8e149784550c985b7531c37a935262f"
server_key_iv: "8df141f3faf28f0270f987e0f7aa28ac"
server_key_version: "encryptionkey@0"
I20260807 19:59:57.471535 31542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:57.498719 31542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:57.502770 31542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:57.503037 31542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:57.520663 31542 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:35979
I20260807 19:59:57.520684 31638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:35979 every 8 connection(s)
I20260807 19:59:57.522330 31542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 19:59:57.526054 31639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:59:57.527490 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 31542
I20260807 19:59:57.527757 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 19:59:57.528620 5910 external_mini_cluster.cc:1428] Setting key d2cb63526f7ae3af9d79361d831f0c05
I20260807 19:59:57.540313 31639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79: Bootstrap starting.
Aug 07 19:59:57 dist-test-slave-6bbx krb5kdc[31526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:59:57.543179 31639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79: Neither blocks nor log segments found. Creating new log.
I20260807 19:59:57.544394 31639 log.cc:824] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:57.547755 31639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79: No bootstrap required, opened a new log
I20260807 19:59:57.552218 31643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:57.530698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56354 (local address 127.5.197.190:35979)
0807 19:59:57.531444 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:57.531456 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:57.531502 (+ 46us) server_negotiation.cc:407] Connection header received
0807 19:59:57.533108 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:57.533134 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:57.533505 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:57.533833 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:57.535576 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:57.536955 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:57.538916 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:57.539590 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:57.539791 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:57.543876 (+ 4085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:57.543886 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:57.543904 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:57.543945 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:57.547658 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:57.548412 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:57.548421 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:57.548429 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:57.548628 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:57.549003 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:57.549008 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:57.549011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:57.549690 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:57.550004 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:57.550422 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 19:59:57.550875 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":323,"threads_started":1}
I20260807 19:59:57.556542 31639 raft_consensus.cc:348] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55d9608b89546af89cd9cee022abd79" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35979 } }
I20260807 19:59:57.556890 31639 raft_consensus.cc:374] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:59:57.556993 31639 raft_consensus.cc:729] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b55d9608b89546af89cd9cee022abd79, State: Initialized, Role: FOLLOWER
I20260807 19:59:57.557559 31639 consensus_queue.cc:260] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55d9608b89546af89cd9cee022abd79" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35979 } }
I20260807 19:59:57.557809 31639 raft_consensus.cc:388] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:59:57.557938 31639 raft_consensus.cc:482] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:59:57.558084 31639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:59:57.560593 31639 raft_consensus.cc:504] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55d9608b89546af89cd9cee022abd79" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35979 } }
I20260807 19:59:57.561074 31639 leader_election.cc:302] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b55d9608b89546af89cd9cee022abd79; no voters:
I20260807 19:59:57.561592 31639 leader_election.cc:288] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:59:57.561700 31646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:59:57.562608 31646 raft_consensus.cc:686] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [term 1 LEADER]: Becoming Leader. State: Replica: b55d9608b89546af89cd9cee022abd79, State: Running, Role: LEADER
I20260807 19:59:57.563081 31646 consensus_queue.cc:237] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55d9608b89546af89cd9cee022abd79" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35979 } }
I20260807 19:59:57.563409 31639 sys_catalog.cc:564] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:59:57.565820 31651 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55d9608b89546af89cd9cee022abd79. Latest consensus state: current_term: 1 leader_uuid: "b55d9608b89546af89cd9cee022abd79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55d9608b89546af89cd9cee022abd79" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35979 } } }
I20260807 19:59:57.566373 31651 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [sys.catalog]: This master's current role is: LEADER
I20260807 19:59:57.566303 31650 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b55d9608b89546af89cd9cee022abd79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55d9608b89546af89cd9cee022abd79" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35979 } } }
I20260807 19:59:57.566781 31650 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79 [sys.catalog]: This master's current role is: LEADER
I20260807 19:59:57.570962 31656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:59:57.576004 31656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:59:57.585263 31656 catalog_manager.cc:1347] Generated new cluster ID: 8d041f32b056464b8f965a9958aff3e8
I20260807 19:59:57.585358 31656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:59:57.595721 31656 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:59:57.596928 31656 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:59:57.602409 31656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79: Generated new TSK 0
I20260807 19:59:57.603313 31656 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 19:59:57.674893 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35979
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:40637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:59:58.017889 31677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:58.018186 31677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:58.018332 31677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:58.025575 31677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:58.025707 31677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:58.025866 31677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 19:59:58.035692 31677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:40637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:58.037026 31677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:58.038336 31677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:58.051260 31686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:58.051519 31688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:58.051721 31685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:58.051990 31677 server_base.cc:1034] running on GCE node
I20260807 19:59:58.052603 31677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:58.053521 31677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:58.054733 31677 hybrid_clock.cc:648] HybridClock initialized: now 1786132798054667 us; error 50 us; skew 500 ppm
I20260807 19:59:58.055042 31677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:58 dist-test-slave-6bbx krb5kdc[31526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132798, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:58.058279 31677 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 19:59:58.059645 31677 webserver.cc:460] Webserver started at http://127.5.197.129:43317/ using document root <none> and password file <none>
I20260807 19:59:58.060339 31677 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:58.060443 31677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:58.060712 31677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:59:58.063614 31677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "c140000232f7452aafd2fc92716d5dfa"
format_stamp: "Formatted at 2026-08-07 19:59:58 on dist-test-slave-6bbx"
server_key: "e52e7d53b3409d05953f9ee283086575"
server_key_iv: "311022c7c1f4869bf9dfcce89ed180bc"
server_key_version: "encryptionkey@0"
I20260807 19:59:58.064471 31677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "c140000232f7452aafd2fc92716d5dfa"
format_stamp: "Formatted at 2026-08-07 19:59:58 on dist-test-slave-6bbx"
server_key: "e52e7d53b3409d05953f9ee283086575"
server_key_iv: "311022c7c1f4869bf9dfcce89ed180bc"
server_key_version: "encryptionkey@0"
I20260807 19:59:58.069502 31677 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:59:58.073072 31698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:58.074380 31677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:59:58.074523 31677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "c140000232f7452aafd2fc92716d5dfa"
format_stamp: "Formatted at 2026-08-07 19:59:58 on dist-test-slave-6bbx"
server_key: "e52e7d53b3409d05953f9ee283086575"
server_key_iv: "311022c7c1f4869bf9dfcce89ed180bc"
server_key_version: "encryptionkey@0"
I20260807 19:59:58.074748 31677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:58.091331 31677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:58.095726 31677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:58.096000 31677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:58.096921 31677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:58.098237 31677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:58.098313 31677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:58.098413 31677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:58.098461 31677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:58.129055 31677 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:46371
I20260807 19:59:58.129102 31848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:46371 every 8 connection(s)
I20260807 19:59:58.130357 31677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:59:58.135473 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 31677
I20260807 19:59:58.135712 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 19:59:58.136543 5910 external_mini_cluster.cc:1428] Setting key cf045779996ab72fbf15b4c8a9224f5f
Aug 07 19:59:58 dist-test-slave-6bbx krb5kdc[31526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132798, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:59:58.152323 31852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:58.132899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:39141 (local address 127.5.197.190:35979)
0807 19:59:58.133370 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:58.133375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:58.134312 (+ 937us) server_negotiation.cc:407] Connection header received
0807 19:59:58.136644 (+ 2332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:58.136650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:58.136736 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:58.136833 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:58.138599 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.139325 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.141496 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.142007 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.142117 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:58.146118 (+ 4001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:58.146124 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:58.146128 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:58.146166 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:58.149134 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:58.149924 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:58.149929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:58.149932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:58.150077 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:58.150496 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:58.150500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:58.150503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:58.150838 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:58.150977 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:58.151754 (+ 777us) server_negotiation.cc:299] Negotiation successful
0807 19:59:58.151973 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":220,"threads_started":1}
I20260807 19:59:58.153268 31853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:58.133452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:35979 (local address 127.5.197.129:39141)
0807 19:59:58.134138 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:58.134176 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:58.136331 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:58.137106 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:58.137118 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:58.137789 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:59:58.138434 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:58.138455 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.139491 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.139496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:58.141352 (+ 1856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:58.141366 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.142250 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.142258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:58.142528 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:58.143251 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:59:58.143279 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:59:58.145887 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:59:58.149270 (+ 3383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:58.149279 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:58.149299 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:58.149797 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:58.150169 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:58.150173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:58.150176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:58.150388 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:58.150946 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:59:58.150952 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:59:58.151335 (+ 383us) client_negotiation.cc:769] Sending connection context
0807 19:59:58.151591 (+ 256us) client_negotiation.cc:240] Negotiation successful
0807 19:59:58.152081 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":257,"threads_started":1}
I20260807 19:59:58.154904 31849 heartbeater.cc:347] Connected to a master server at 127.5.197.190:35979
I20260807 19:59:58.155179 31849 heartbeater.cc:464] Registering TS with master...
I20260807 19:59:58.155947 31849 heartbeater.cc:511] Master 127.5.197.190:35979 requested a full tablet report, sending...
I20260807 19:59:58.158085 31593 ts_manager.cc:194] Registered new tserver with Master: c140000232f7452aafd2fc92716d5dfa (127.5.197.129:46371)
I20260807 19:59:58.159565 31593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:39141
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 19:59:58.208614 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35979
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:40637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:59:58.547351 31857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:58.547627 31857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:58.547791 31857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:58.554768 31857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:58.554884 31857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:58.555038 31857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 19:59:58.564618 31857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:40637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:58.565827 31857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:58.567099 31857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:58.580075 31865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:58.580084 31867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:58.580603 31864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:58.580845 31857 server_base.cc:1034] running on GCE node
I20260807 19:59:58.581463 31857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:58.582406 31857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:58.583612 31857 hybrid_clock.cc:648] HybridClock initialized: now 1786132798583559 us; error 42 us; skew 500 ppm
I20260807 19:59:58.583946 31857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:58 dist-test-slave-6bbx krb5kdc[31526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132798, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:58.587085 31857 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 19:59:58.588503 31857 webserver.cc:460] Webserver started at http://127.5.197.130:44213/ using document root <none> and password file <none>
I20260807 19:59:58.589178 31857 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:58.589300 31857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:58.589609 31857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:59:58.592519 31857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "3cece4e7d6c3470d912f2227ed9924b1"
format_stamp: "Formatted at 2026-08-07 19:59:58 on dist-test-slave-6bbx"
server_key: "1f386165dbc6b939385f62066cef3b6e"
server_key_iv: "914337cbb42877e58c6d76d4580aeb5a"
server_key_version: "encryptionkey@0"
I20260807 19:59:58.593315 31857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "3cece4e7d6c3470d912f2227ed9924b1"
format_stamp: "Formatted at 2026-08-07 19:59:58 on dist-test-slave-6bbx"
server_key: "1f386165dbc6b939385f62066cef3b6e"
server_key_iv: "914337cbb42877e58c6d76d4580aeb5a"
server_key_version: "encryptionkey@0"
I20260807 19:59:58.598347 31857 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 19:59:58.601673 31876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:58.602927 31857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:59:58.603080 31857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "3cece4e7d6c3470d912f2227ed9924b1"
format_stamp: "Formatted at 2026-08-07 19:59:58 on dist-test-slave-6bbx"
server_key: "1f386165dbc6b939385f62066cef3b6e"
server_key_iv: "914337cbb42877e58c6d76d4580aeb5a"
server_key_version: "encryptionkey@0"
I20260807 19:59:58.603262 31857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:58.627323 31857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:58.631438 31857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:58.631734 31857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:58.632795 31857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:58.634123 31857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:58.634202 31857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:58.634323 31857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:58.634378 31857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:58.665758 31857 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41617
I20260807 19:59:58.665793 32023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41617 every 8 connection(s)
I20260807 19:59:58.667012 31857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:59:58.669127 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 31857
I20260807 19:59:58.669277 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 19:59:58.669749 5910 external_mini_cluster.cc:1428] Setting key 35124b4ff1ec93131275482c46c51144
Aug 07 19:59:58 dist-test-slave-6bbx krb5kdc[31526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132798, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:59:58.688271 32028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:58.669617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:49141 (local address 127.5.197.190:35979)
0807 19:59:58.670085 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:58.670092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:58.671179 (+ 1087us) server_negotiation.cc:407] Connection header received
0807 19:59:58.673666 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:58.673670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:58.673733 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:58.673825 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:58.675758 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.676504 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.678480 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.678897 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.678987 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:58.682842 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:58.682847 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:58.682850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:58.682880 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:58.685294 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:58.686062 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:58.686065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:58.686067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:58.686180 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:58.686596 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:58.686600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:58.686602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:58.686912 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:58.687046 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:58.687702 (+ 656us) server_negotiation.cc:299] Negotiation successful
0807 19:59:58.687914 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":224,"threads_started":1}
I20260807 19:59:58.688987 32029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:58.670192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:35979 (local address 127.5.197.130:49141)
0807 19:59:58.671022 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:58.671076 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:58.673388 (+ 2312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:58.674076 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:58.674086 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:58.674823 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:59:58.675566 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:58.675589 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.676649 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.676654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:58.678351 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:58.678367 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:58.679104 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:58.679110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:58.679391 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:58.680063 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:59:58.680092 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:59:58.682633 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:59:58.685432 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:58.685440 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:58.685453 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:58.685964 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:58.686271 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:58.686275 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:58.686278 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:58.686495 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:58.687041 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:59:58.687047 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:59:58.687334 (+ 287us) client_negotiation.cc:769] Sending connection context
0807 19:59:58.687545 (+ 211us) client_negotiation.cc:240] Negotiation successful
0807 19:59:58.687950 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":338,"threads_started":1}
I20260807 19:59:58.690289 32024 heartbeater.cc:347] Connected to a master server at 127.5.197.190:35979
I20260807 19:59:58.690582 32024 heartbeater.cc:464] Registering TS with master...
I20260807 19:59:58.691249 32024 heartbeater.cc:511] Master 127.5.197.190:35979 requested a full tablet report, sending...
I20260807 19:59:58.692668 31593 ts_manager.cc:194] Registered new tserver with Master: 3cece4e7d6c3470d912f2227ed9924b1 (127.5.197.130:41617)
I20260807 19:59:58.693444 31593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:49141
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 19:59:58.739270 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35979
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:40637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:59:59.076093 32033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:59:59.076460 32033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:59:59.076607 32033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:59:59.086452 32033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:59:59.086591 32033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:59:59.086764 32033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 19:59:59.097517 32033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:40637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:35979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:59:59.099037 32033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:59:59.100842 32033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:59:59.116341 32039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:59.116394 32038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:59:59.117465 32041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:59:59.117632 32033 server_base.cc:1034] running on GCE node
I20260807 19:59:59.119179 32033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:59:59.120322 32033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:59:59.121538 32033 hybrid_clock.cc:648] HybridClock initialized: now 1786132799121481 us; error 46 us; skew 500 ppm
I20260807 19:59:59.121843 32033 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:59:59 dist-test-slave-6bbx krb5kdc[31526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132799, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:59:59.125681 32033 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 19:59:59.127985 32033 webserver.cc:460] Webserver started at http://127.5.197.131:41815/ using document root <none> and password file <none>
I20260807 19:59:59.128859 32033 fs_manager.cc:359] Metadata directory not provided
I20260807 19:59:59.128991 32033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:59:59.129333 32033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:59:59.133534 32033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "7ce2bffc28a243248ae1ce53f2b9113d"
format_stamp: "Formatted at 2026-08-07 19:59:59 on dist-test-slave-6bbx"
server_key: "accc5f518c149d4a7a08ddc406d1dd9b"
server_key_iv: "5ab6e1c6c7f0f13136e5692e20eac874"
server_key_version: "encryptionkey@0"
I20260807 19:59:59.134490 32033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "7ce2bffc28a243248ae1ce53f2b9113d"
format_stamp: "Formatted at 2026-08-07 19:59:59 on dist-test-slave-6bbx"
server_key: "accc5f518c149d4a7a08ddc406d1dd9b"
server_key_iv: "5ab6e1c6c7f0f13136e5692e20eac874"
server_key_version: "encryptionkey@0"
I20260807 19:59:59.140799 32033 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260807 19:59:59.145148 32051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:59.146728 32033 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260807 19:59:59.146891 32033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "7ce2bffc28a243248ae1ce53f2b9113d"
format_stamp: "Formatted at 2026-08-07 19:59:59 on dist-test-slave-6bbx"
server_key: "accc5f518c149d4a7a08ddc406d1dd9b"
server_key_iv: "5ab6e1c6c7f0f13136e5692e20eac874"
server_key_version: "encryptionkey@0"
I20260807 19:59:59.147070 32033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:59:59.162467 31849 heartbeater.cc:503] Master 127.5.197.190:35979 was elected leader, sending a full tablet report...
I20260807 19:59:59.164577 32033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:59:59.168445 32033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:59:59.168725 32033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:59:59.169610 32033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:59:59.170912 32033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:59:59.171010 32033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:59.171136 32033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:59:59.171193 32033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:59:59.203473 32033 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:39667
I20260807 19:59:59.203526 32201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:39667 every 8 connection(s)
I20260807 19:59:59.204766 32033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:59:59.210898 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 32033
I20260807 19:59:59.211061 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 19:59:59.211488 5910 external_mini_cluster.cc:1428] Setting key 86e6757ba63eb7605022f7ee2cfbf7b1
Aug 07 19:59:59 dist-test-slave-6bbx krb5kdc[31526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132799, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 19:59:59.223969 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.207959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:35739 (local address 127.5.197.190:35979)
0807 19:59:59.208449 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.208455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.208740 (+ 285us) server_negotiation.cc:407] Connection header received
0807 19:59:59.210533 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.210539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.210624 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.210756 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:59.212295 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.213337 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.215128 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.215547 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.215641 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.218845 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:59.218849 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:59.218853 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:59.218883 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:59.221367 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.222037 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.222041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.222043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.222173 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.222527 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.222530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.222531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.222806 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:59.222922 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.223507 (+ 585us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.223699 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":222,"threads_started":1}
I20260807 19:59:59.224906 32210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.207810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:35979 (local address 127.5.197.131:35739)
0807 19:59:59.208586 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:59.208625 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:59.210266 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:59.210927 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:59.210934 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:59.211473 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:59:59.212130 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.212149 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.213484 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.213488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.214993 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.215006 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.215788 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.215795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.215989 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.216566 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:59:59.216592 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:59:59.218649 (+ 2057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:59:59.221494 (+ 2845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:59.221500 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:59.221513 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:59.221939 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:59.222255 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:59:59.222258 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:59:59.222260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:59:59.222442 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:59:59.222901 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:59:59.222907 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:59:59.223200 (+ 293us) client_negotiation.cc:769] Sending connection context
0807 19:59:59.223417 (+ 217us) client_negotiation.cc:240] Negotiation successful
0807 19:59:59.223827 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":330,"threads_started":1}
I20260807 19:59:59.226161 32205 heartbeater.cc:347] Connected to a master server at 127.5.197.190:35979
I20260807 19:59:59.226450 32205 heartbeater.cc:464] Registering TS with master...
I20260807 19:59:59.227190 32205 heartbeater.cc:511] Master 127.5.197.190:35979 requested a full tablet report, sending...
I20260807 19:59:59.228587 31592 ts_manager.cc:194] Registered new tserver with Master: 7ce2bffc28a243248ae1ce53f2b9113d (127.5.197.131:39667)
I20260807 19:59:59.229528 31592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:35739
I20260807 19:59:59.239030 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:59:59.256403 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.243585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47924 (local address 127.5.197.190:35979)
0807 19:59:59.243799 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.243806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.244199 (+ 393us) server_negotiation.cc:407] Connection header received
0807 19:59:59.244334 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.244337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.244397 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.244473 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:59.245953 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.246704 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.248086 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.248490 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.248585 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.251144 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:59.251171 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:59.251175 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:59.251215 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:59.253848 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.254554 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.254558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.254560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.254684 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.254987 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.254990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.254992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.255352 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:59.255567 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.255887 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.256063 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:59:59.260600 31592 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:59:59.267602 31592 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:59:59.296367 32229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.281542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39667 (local address 127.0.0.1:39332)
0807 19:59:59.282091 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:59.282108 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:59.282242 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:59.289308 (+ 7066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:59.289313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:59.289335 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:59.289745 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.289758 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.291829 (+ 2071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.291835 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.293878 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.293894 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.295592 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.295597 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.295781 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.295814 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:59:59.295882 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 19:59:59.296009 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":695,"threads_started":1}
I20260807 19:59:59.296855 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.280194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:46371 (local address 127.0.0.1:49344)
0807 19:59:59.280948 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:59.280986 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:59.281146 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:59.290143 (+ 8997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:59.290148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:59.290172 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:59.290493 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.290502 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.292802 (+ 2300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.292807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.294526 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.294538 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.296064 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.296071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.296246 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.296278 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:59:59.296343 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 19:59:59.296470 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":556,"threads_started":1}
I20260807 19:59:59.296972 32224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.280323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41617 (local address 127.0.0.1:37678)
0807 19:59:59.281601 (+ 1278us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:59.281618 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:59.281746 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:59.289031 (+ 7285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:59.289039 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:59.289068 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:59.289525 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.289538 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.291485 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.291490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.293598 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.293611 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.295361 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.295368 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.295553 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.295607 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 19:59:59.295792 (+ 185us) client_negotiation.cc:240] Negotiation successful
0807 19:59:59.296483 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1158,"mutex_wait_us":3,"thread_start_us":970,"threads_started":1}
I20260807 19:59:59.296346 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.280736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37678 (local address 127.5.197.130:41617)
0807 19:59:59.288346 (+ 7610us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.288357 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.288392 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:59:59.288502 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.288511 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.288789 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.289019 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:59.289769 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.291359 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.293762 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.295136 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.295298 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.295515 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.295841 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.296017 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7423,"thread_start_us":7311,"threads_started":1}
I20260807 19:59:59.297986 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.281973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39332 (local address 127.5.197.131:39667)
0807 19:59:59.288752 (+ 6779us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.288758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.288784 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:59:59.288860 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.288865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.289069 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.289945 (+ 876us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:59.290216 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.291647 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.294038 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.295367 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.297373 (+ 2006us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.297582 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.297638 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.297747 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6631,"thread_start_us":6468,"threads_started":1}
I20260807 19:59:59.297991 32227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.280628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49344 (local address 127.5.197.129:46371)
0807 19:59:59.289713 (+ 9085us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.289719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.289741 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:59:59.289821 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.289826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.289971 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.290126 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:59.290636 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.292633 (+ 1997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.294676 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.295835 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.297264 (+ 1429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.297487 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.297548 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.297691 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8941,"thread_start_us":8784,"threads_started":1}
I20260807 19:59:59.301066 32112 tablet_service.cc:1467] Processing CreateTablet for tablet b7b75ded448448009a1f1419d06a6942 (DEFAULT_TABLE table=test-table [id=a50aaf093acc440b8ab026e058add301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:59:59.300946 31942 tablet_service.cc:1467] Processing CreateTablet for tablet b7b75ded448448009a1f1419d06a6942 (DEFAULT_TABLE table=test-table [id=a50aaf093acc440b8ab026e058add301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:59:59.301568 31763 tablet_service.cc:1467] Processing CreateTablet for tablet b7b75ded448448009a1f1419d06a6942 (DEFAULT_TABLE table=test-table [id=a50aaf093acc440b8ab026e058add301]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:59:59.302482 31942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7b75ded448448009a1f1419d06a6942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:59:59.302484 32112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7b75ded448448009a1f1419d06a6942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:59:59.302917 31763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7b75ded448448009a1f1419d06a6942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:59:59.314105 32231 tablet_bootstrap.cc:492] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Bootstrap starting.
I20260807 19:59:59.316890 32234 tablet_bootstrap.cc:492] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Bootstrap starting.
I20260807 19:59:59.317958 32231 tablet_bootstrap.cc:654] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Neither blocks nor log segments found. Creating new log.
I20260807 19:59:59.319314 32231 log.cc:824] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:59.320397 32234 tablet_bootstrap.cc:654] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Neither blocks nor log segments found. Creating new log.
I20260807 19:59:59.320798 32235 tablet_bootstrap.cc:492] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Bootstrap starting.
I20260807 19:59:59.321966 32234 log.cc:824] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:59.323925 32231 tablet_bootstrap.cc:492] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: No bootstrap required, opened a new log
I20260807 19:59:59.324061 32235 tablet_bootstrap.cc:654] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Neither blocks nor log segments found. Creating new log.
I20260807 19:59:59.324200 32231 ts_tablet_manager.cc:1397] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 19:59:59.325066 32234 tablet_bootstrap.cc:492] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: No bootstrap required, opened a new log
I20260807 19:59:59.325253 32235 log.cc:824] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Log is configured to *not* fsync() on all Append() calls
I20260807 19:59:59.325346 32234 ts_tablet_manager.cc:1397] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 19:59:59.328205 32235 tablet_bootstrap.cc:492] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: No bootstrap required, opened a new log
I20260807 19:59:59.328456 32235 ts_tablet_manager.cc:1397] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260807 19:59:59.332036 32231 raft_consensus.cc:348] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.332433 32231 raft_consensus.cc:374] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:59:59.332549 32231 raft_consensus.cc:729] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ce2bffc28a243248ae1ce53f2b9113d, State: Initialized, Role: FOLLOWER
I20260807 19:59:59.333138 32231 consensus_queue.cc:260] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.334237 32205 heartbeater.cc:503] Master 127.5.197.190:35979 was elected leader, sending a full tablet report...
I20260807 19:59:59.334899 32231 ts_tablet_manager.cc:1428] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 19:59:59.335532 32234 raft_consensus.cc:348] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.335997 32234 raft_consensus.cc:374] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:59:59.336090 32234 raft_consensus.cc:729] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cece4e7d6c3470d912f2227ed9924b1, State: Initialized, Role: FOLLOWER
I20260807 19:59:59.336663 32234 consensus_queue.cc:260] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.337769 32024 heartbeater.cc:503] Master 127.5.197.190:35979 was elected leader, sending a full tablet report...
I20260807 19:59:59.338384 32234 ts_tablet_manager.cc:1428] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260807 19:59:59.339205 32235 raft_consensus.cc:348] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.339641 32235 raft_consensus.cc:374] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:59:59.339781 32235 raft_consensus.cc:729] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c140000232f7452aafd2fc92716d5dfa, State: Initialized, Role: FOLLOWER
I20260807 19:59:59.340392 32235 consensus_queue.cc:260] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.342042 32235 ts_tablet_manager.cc:1428] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Time spent starting tablet: real 0.013s user 0.005s sys 0.008s
W20260807 19:59:59.382687 31851 tablet.cc:2369] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:59:59.419087 32026 tablet.cc:2369] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:59:59.456403 32206 tablet.cc:2369] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:59:59.460278 32242 raft_consensus.cc:482] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:59:59.460590 32242 raft_consensus.cc:504] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.462441 32242 leader_election.cc:288] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c140000232f7452aafd2fc92716d5dfa (127.5.197.129:46371), 7ce2bffc28a243248ae1ce53f2b9113d (127.5.197.131:39667)
I20260807 19:59:59.469543 32227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.462832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:36815 (local address 127.5.197.129:46371)
0807 19:59:59.463089 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.463096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.463448 (+ 352us) server_negotiation.cc:407] Connection header received
0807 19:59:59.463814 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.463820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.463901 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.463970 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:59.464736 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.465660 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.467730 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.468590 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.468722 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.468797 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.469172 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.469304 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:59:59.469588 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.462670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:46371 (local address 127.5.197.130:36815)
0807 19:59:59.463336 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:59.463357 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:59.463584 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:59.464165 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:59.464170 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:59.464199 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:59.464586 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.464600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.465793 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.465799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.467537 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.467550 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.468834 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.468842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.468998 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.469039 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 19:59:59.469112 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 19:59:59.469221 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":38,"thread_start_us":323,"threads_started":1}
I20260807 19:59:59.469892 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.463718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:56807 (local address 127.5.197.131:39667)
0807 19:59:59.463954 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.463960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.464236 (+ 276us) server_negotiation.cc:407] Connection header received
0807 19:59:59.464464 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.464470 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.464545 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.464645 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:59:59.465253 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.466129 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.467876 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.468631 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.468805 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.468873 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.469517 (+ 644us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.469647 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 19:59:59.470557 32245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.463437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:39667 (local address 127.5.197.130:56807)
0807 19:59:59.464107 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0807 19:59:59.464122 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:59:59.464287 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:59:59.464656 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:59:59.464661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:59:59.464687 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:59:59.465095 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.465107 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.466269 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.466273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.467731 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:59:59.467746 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.468870 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.468875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:59:59.469011 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.469062 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 19:59:59.470062 (+ 1000us) client_negotiation.cc:240] Negotiation successful
0807 19:59:59.470188 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":19,"thread_start_us":339,"threads_started":1}
I20260807 19:59:59.470633 31788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7b75ded448448009a1f1419d06a6942" candidate_uuid: "3cece4e7d6c3470d912f2227ed9924b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c140000232f7452aafd2fc92716d5dfa" is_pre_election: true
I20260807 19:59:59.471261 31788 raft_consensus.cc:2454] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cece4e7d6c3470d912f2227ed9924b1 in term 0.
I20260807 19:59:59.471517 32139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7b75ded448448009a1f1419d06a6942" candidate_uuid: "3cece4e7d6c3470d912f2227ed9924b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" is_pre_election: true
I20260807 19:59:59.471954 31880 leader_election.cc:302] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cece4e7d6c3470d912f2227ed9924b1, c140000232f7452aafd2fc92716d5dfa; no voters:
I20260807 19:59:59.472046 32139 raft_consensus.cc:2454] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cece4e7d6c3470d912f2227ed9924b1 in term 0.
I20260807 19:59:59.472339 32242 raft_consensus.cc:2781] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:59:59.472506 32242 raft_consensus.cc:482] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:59:59.472620 32242 raft_consensus.cc:3037] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:59:59.474975 32242 raft_consensus.cc:504] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.475585 32242 leader_election.cc:288] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [CANDIDATE]: Term 1 election: Requested vote from peers c140000232f7452aafd2fc92716d5dfa (127.5.197.129:46371), 7ce2bffc28a243248ae1ce53f2b9113d (127.5.197.131:39667)
I20260807 19:59:59.476007 31788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7b75ded448448009a1f1419d06a6942" candidate_uuid: "3cece4e7d6c3470d912f2227ed9924b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c140000232f7452aafd2fc92716d5dfa"
I20260807 19:59:59.476187 32139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7b75ded448448009a1f1419d06a6942" candidate_uuid: "3cece4e7d6c3470d912f2227ed9924b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce2bffc28a243248ae1ce53f2b9113d"
I20260807 19:59:59.476222 31788 raft_consensus.cc:3037] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:59:59.476397 32139 raft_consensus.cc:3037] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:59:59.479467 32139 raft_consensus.cc:2454] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cece4e7d6c3470d912f2227ed9924b1 in term 1.
I20260807 19:59:59.479468 31788 raft_consensus.cc:2454] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cece4e7d6c3470d912f2227ed9924b1 in term 1.
I20260807 19:59:59.479871 31880 leader_election.cc:302] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cece4e7d6c3470d912f2227ed9924b1, c140000232f7452aafd2fc92716d5dfa; no voters:
I20260807 19:59:59.480154 32242 raft_consensus.cc:2781] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:59:59.480623 32242 raft_consensus.cc:686] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3cece4e7d6c3470d912f2227ed9924b1, State: Running, Role: LEADER
I20260807 19:59:59.481065 32242 consensus_queue.cc:237] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } }
I20260807 19:59:59.485538 31592 catalog_manager.cc:5495] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cece4e7d6c3470d912f2227ed9924b1 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "3cece4e7d6c3470d912f2227ed9924b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cece4e7d6c3470d912f2227ed9924b1" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 } health_report { overall_health: UNKNOWN } } }
I20260807 19:59:59.529342 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.523589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37688 (local address 127.5.197.130:41617)
0807 19:59:59.523812 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.523819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.523953 (+ 134us) server_negotiation.cc:407] Connection header received
0807 19:59:59.524235 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.524239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.524340 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.524480 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:59:59.524879 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.525602 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.527009 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.527444 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.527556 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.528174 (+ 618us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:59:59.528742 (+ 568us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:59:59.528885 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.528977 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.529060 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 19:59:59.542770 32139 raft_consensus.cc:1261] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 1 FOLLOWER]: Refusing update from remote peer 3cece4e7d6c3470d912f2227ed9924b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:59:59.542778 31788 raft_consensus.cc:1261] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 1 FOLLOWER]: Refusing update from remote peer 3cece4e7d6c3470d912f2227ed9924b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:59:59.543954 32242 consensus_queue.cc:1035] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c140000232f7452aafd2fc92716d5dfa" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:59:59.544286 32246 consensus_queue.cc:1035] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce2bffc28a243248ae1ce53f2b9113d" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 39667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:59:59.559408 32251 mvcc.cc:205] Tried to move back new op lower bound from 7315999946910298112 to 7315999946678329344. Current Snapshot: MvccSnapshot[applied={T|T < 7315999946910298112}]
I20260807 19:59:59.573756 31592 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:59:59.574029 31592 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:59:59.577927 31592 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b55d9608b89546af89cd9cee022abd79: Sending DeleteTablet for 3 replicas of tablet b7b75ded448448009a1f1419d06a6942
I20260807 19:59:59.579219 32112 tablet_service.cc:1514] Processing DeleteTablet for tablet b7b75ded448448009a1f1419d06a6942 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:59:59 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:39332
I20260807 19:59:59.579234 31942 tablet_service.cc:1514] Processing DeleteTablet for tablet b7b75ded448448009a1f1419d06a6942 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:59:59 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:37678
I20260807 19:59:59.580116 32260 tablet_replica.cc:330] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: stopping tablet replica
I20260807 19:59:59.580190 31763 tablet_service.cc:1514] Processing DeleteTablet for tablet b7b75ded448448009a1f1419d06a6942 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:59:59 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:49344
I20260807 19:59:59.580545 32260 raft_consensus.cc:2229] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:59:59.581081 32260 raft_consensus.cc:2258] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:59:59.582518 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 31677
I20260807 19:59:59.593106 32260 ts_tablet_manager.cc:1905] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:59:59.599138 32262 tablet_replica.cc:330] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: stopping tablet replica
I20260807 19:59:59.599647 32262 raft_consensus.cc:2229] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:59:59.600329 32262 raft_consensus.cc:2258] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:59:59.606247 32260 ts_tablet_manager.cc:1918] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:59:59.606427 32260 log.cc:1196] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/b7b75ded448448009a1f1419d06a6942
I20260807 19:59:59.609050 32262 ts_tablet_manager.cc:1905] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:59:59.614813 32262 ts_tablet_manager.cc:1918] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:59:59.614977 32262 log.cc:1196] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/b7b75ded448448009a1f1419d06a6942
I20260807 19:59:59.615556 32262 ts_tablet_manager.cc:1939] T b7b75ded448448009a1f1419d06a6942 P c140000232f7452aafd2fc92716d5dfa: Deleting consensus metadata
I20260807 19:59:59.617568 31574 catalog_manager.cc:4841] TS c140000232f7452aafd2fc92716d5dfa (127.5.197.129:46371): tablet b7b75ded448448009a1f1419d06a6942 (table test-table [id=a50aaf093acc440b8ab026e058add301]) successfully deleted
I20260807 19:59:59.617751 32261 tablet_replica.cc:330] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: stopping tablet replica
I20260807 19:59:59.618216 32261 raft_consensus.cc:2229] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:59:59.618791 32261 raft_consensus.cc:2258] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:59:59.620520 32260 ts_tablet_manager.cc:1939] T b7b75ded448448009a1f1419d06a6942 P 7ce2bffc28a243248ae1ce53f2b9113d: Deleting consensus metadata
I20260807 19:59:59.620954 32261 ts_tablet_manager.cc:1905] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 19:59:59 dist-test-slave-6bbx krb5kdc[31526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 19:59:59.624504 31574 catalog_manager.cc:4841] TS 7ce2bffc28a243248ae1ce53f2b9113d (127.5.197.131:39667): tablet b7b75ded448448009a1f1419d06a6942 (table test-table [id=a50aaf093acc440b8ab026e058add301]) successfully deleted
I20260807 19:59:59.628412 32261 ts_tablet_manager.cc:1918] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:59:59.628609 32261 log.cc:1196] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/b7b75ded448448009a1f1419d06a6942
I20260807 19:59:59.629187 32261 ts_tablet_manager.cc:1939] T b7b75ded448448009a1f1419d06a6942 P 3cece4e7d6c3470d912f2227ed9924b1: Deleting consensus metadata
I20260807 19:59:59.630918 31572 catalog_manager.cc:4841] TS 3cece4e7d6c3470d912f2227ed9924b1 (127.5.197.130:41617): tablet b7b75ded448448009a1f1419d06a6942 (table test-table [id=a50aaf093acc440b8ab026e058add301]) successfully deleted
I20260807 19:59:59.631383 32227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.584168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49354 (local address 127.5.197.129:46371)
0807 19:59:59.584371 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.584378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.607869 (+ 23491us) server_negotiation.cc:407] Connection header received
0807 19:59:59.612095 (+ 4226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.612101 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.612189 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.612273 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:59.614131 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.615234 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.619163 (+ 3929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.619617 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.619755 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.625219 (+ 5464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:59.625233 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:59.625247 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:59.625280 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:59.628050 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.628882 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.628890 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.628892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.629029 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.629443 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.629447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.629450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.629824 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:59.630123 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.630458 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.630688 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:59:59.632143 31842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:59.721439 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 31677
I20260807 19:59:59.761534 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 31857
Aug 07 19:59:59 dist-test-slave-6bbx krb5kdc[31526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 19:59:59.777995 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.762501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37702 (local address 127.5.197.130:41617)
0807 19:59:59.762682 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.762694 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.762714 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:59:59.762826 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.762832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.762911 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.763000 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:59.764448 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.765351 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.766612 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.767069 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.767186 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.771710 (+ 4524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:59.771729 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:59.771746 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:59.771788 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:59.775008 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.775883 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.775891 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.775894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.776075 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.776507 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.776512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.776515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.776924 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:59.777187 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.777512 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.777693 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 19:59:59.778781 32017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:59:59.892061 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 31857
I20260807 19:59:59.915417 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 32033
Aug 07 19:59:59 dist-test-slave-6bbx krb5kdc[31526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 19:59:59.930051 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:59:59.916161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39340 (local address 127.5.197.131:39667)
0807 19:59:59.916353 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:59:59.916358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:59:59.916403 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:59:59.916564 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:59:59.916567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:59:59.916630 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:59:59.916713 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:59:59.918025 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.918788 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.920086 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:59:59.920489 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:59:59.920583 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:59:59.924939 (+ 4356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:59:59.924954 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:59:59.924969 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:59:59.925003 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:59:59.927553 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.928187 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.928194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.928196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.928386 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:59:59.928742 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:59:59.928746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:59:59.928748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:59:59.929120 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:59:59.929393 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 19:59:59.929624 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 19:59:59.929792 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 19:59:59.930734 32195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:00.019411 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 32033
I20260807 20:00:00.040217 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 31542
I20260807 20:00:00.041334 31634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:00.152045 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 31542
2026-08-07T20:00:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4580 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T20:00:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:00Z Disabled control of system clock
I20260807 20:00:00.250391 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:39409
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:39409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:00:00.585865 32275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:00.586154 32275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:00.586270 32275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:00.593317 32275 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:00.593413 32275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:00.593474 32275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:00.593549 32275 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:00.593603 32275 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:00.602577 32275 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:39409
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:39409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:00.603900 32275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:00.605692 32275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:00.616744 32283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:00.616881 32284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:00.616875 32289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:00.617820 32275 server_base.cc:1034] running on GCE node
I20260807 20:00:00.618553 32275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:00.619906 32275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:00.621099 32275 hybrid_clock.cc:648] HybridClock initialized: now 1786132800621048 us; error 46 us; skew 500 ppm
I20260807 20:00:00.621420 32275 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:00.626730 32275 webserver.cc:460] Webserver started at http://127.5.197.190:43077/ using document root <none> and password file <none>
I20260807 20:00:00.627424 32275 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:00.627528 32275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:00.627907 32275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:00.630740 32275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "be45d9651b36472fb115a4336b2045d1"
format_stamp: "Formatted at 2026-08-07 20:00:00 on dist-test-slave-6bbx"
server_key: "8d4f1ba1068a3514877513bbff1f2540"
server_key_iv: "711bcb29c33daf76b474c0f1546ea00e"
server_key_version: "encryptionkey@0"
I20260807 20:00:00.631538 32275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "be45d9651b36472fb115a4336b2045d1"
format_stamp: "Formatted at 2026-08-07 20:00:00 on dist-test-slave-6bbx"
server_key: "8d4f1ba1068a3514877513bbff1f2540"
server_key_iv: "711bcb29c33daf76b474c0f1546ea00e"
server_key_version: "encryptionkey@0"
I20260807 20:00:00.636813 32275 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 20:00:00.640059 32296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:00.641311 32275 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 20:00:00.641474 32275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "be45d9651b36472fb115a4336b2045d1"
format_stamp: "Formatted at 2026-08-07 20:00:00 on dist-test-slave-6bbx"
server_key: "8d4f1ba1068a3514877513bbff1f2540"
server_key_iv: "711bcb29c33daf76b474c0f1546ea00e"
server_key_version: "encryptionkey@0"
I20260807 20:00:00.641661 32275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:00.660961 32275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:00.661775 32275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:00.662050 32275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:00.679396 32275 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:39409
I20260807 20:00:00.679428 32363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:39409 every 8 connection(s)
I20260807 20:00:00.680750 32275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:00.684433 32366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:00.687211 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 32275
I20260807 20:00:00.687402 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:00.687974 5910 external_mini_cluster.cc:1428] Setting key a765318b2ca01f3ead5f3991d5350f6a
I20260807 20:00:00.696128 32366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1: Bootstrap starting.
I20260807 20:00:00.699110 32366 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:00.700202 32366 log.cc:824] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:00.701417 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:00.689912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40902 (local address 127.5.197.190:39409)
0807 20:00:00.690917 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:00.690927 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:00.690967 (+ 40us) server_negotiation.cc:407] Connection header received
0807 20:00:00.692689 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:00.692710 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:00.693149 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:00.693522 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:00.694156 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:00.695487 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:00.696957 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:00.697635 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:00.697805 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:00.698893 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:00.698900 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:00.698914 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:00.699473 (+ 559us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:00.699576 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:00.699597 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:00.699729 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:00.699954 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 20:00:00.700257 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":404,"threads_started":1}
I20260807 20:00:00.703302 32366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1: No bootstrap required, opened a new log
I20260807 20:00:00.710852 32366 raft_consensus.cc:348] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be45d9651b36472fb115a4336b2045d1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39409 } }
I20260807 20:00:00.711172 32366 raft_consensus.cc:374] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:00.711247 32366 raft_consensus.cc:729] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be45d9651b36472fb115a4336b2045d1, State: Initialized, Role: FOLLOWER
I20260807 20:00:00.711781 32366 consensus_queue.cc:260] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be45d9651b36472fb115a4336b2045d1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39409 } }
I20260807 20:00:00.712013 32366 raft_consensus.cc:388] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:00.712116 32366 raft_consensus.cc:482] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:00.712240 32366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:00.714637 32366 raft_consensus.cc:504] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be45d9651b36472fb115a4336b2045d1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39409 } }
I20260807 20:00:00.715078 32366 leader_election.cc:302] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be45d9651b36472fb115a4336b2045d1; no voters:
I20260807 20:00:00.715603 32366 leader_election.cc:288] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:00.715786 32373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:00.716452 32373 raft_consensus.cc:686] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [term 1 LEADER]: Becoming Leader. State: Replica: be45d9651b36472fb115a4336b2045d1, State: Running, Role: LEADER
I20260807 20:00:00.716944 32373 consensus_queue.cc:237] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be45d9651b36472fb115a4336b2045d1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39409 } }
I20260807 20:00:00.717657 32366 sys_catalog.cc:564] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:00.719944 32376 sys_catalog.cc:455] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be45d9651b36472fb115a4336b2045d1. Latest consensus state: current_term: 1 leader_uuid: "be45d9651b36472fb115a4336b2045d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be45d9651b36472fb115a4336b2045d1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39409 } } }
I20260807 20:00:00.720387 32376 sys_catalog.cc:458] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:00.720670 32375 sys_catalog.cc:455] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be45d9651b36472fb115a4336b2045d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be45d9651b36472fb115a4336b2045d1" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 39409 } } }
I20260807 20:00:00.720971 32375 sys_catalog.cc:458] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:00.723057 32383 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:00.727427 32383 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:00.736359 32383 catalog_manager.cc:1347] Generated new cluster ID: 3939563a62a34391a54b099022f5cc4d
I20260807 20:00:00.736478 32383 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:00.749900 32383 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:00.751709 32383 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:00.767704 32383 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1: Generated new TSK 0
I20260807 20:00:00.768774 32383 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:00.775419 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39409
--builtin_ntp_servers=127.5.197.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:00:01.119681 32393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:01.119969 32393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:01.120105 32393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:01.127185 32393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:01.127297 32393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:01.127447 32393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 20:00:01.136408 32393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:01.137660 32393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:01.139443 32393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:01.152217 32398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:01.152199 32403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:01.152268 32399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:01.152979 32393 server_base.cc:1034] running on GCE node
I20260807 20:00:01.153622 32393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:01.154597 32393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:01.155797 32393 hybrid_clock.cc:648] HybridClock initialized: now 1786132801155739 us; error 48 us; skew 500 ppm
I20260807 20:00:01.156111 32393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:01.158416 32393 webserver.cc:460] Webserver started at http://127.5.197.129:39145/ using document root <none> and password file <none>
I20260807 20:00:01.159090 32393 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:01.159197 32393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:01.159528 32393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:01.162588 32393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "e09095dde1a245a5952ab5f1aa4ca948"
format_stamp: "Formatted at 2026-08-07 20:00:01 on dist-test-slave-6bbx"
server_key: "389fa4665e6745ebd69b8a0887efd79c"
server_key_iv: "9f47e13721b935c7e25f62c51c96e006"
server_key_version: "encryptionkey@0"
I20260807 20:00:01.163378 32393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "e09095dde1a245a5952ab5f1aa4ca948"
format_stamp: "Formatted at 2026-08-07 20:00:01 on dist-test-slave-6bbx"
server_key: "389fa4665e6745ebd69b8a0887efd79c"
server_key_iv: "9f47e13721b935c7e25f62c51c96e006"
server_key_version: "encryptionkey@0"
I20260807 20:00:01.168550 32393 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 20:00:01.171906 32409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:01.173178 32393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 20:00:01.173336 32393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "e09095dde1a245a5952ab5f1aa4ca948"
format_stamp: "Formatted at 2026-08-07 20:00:01 on dist-test-slave-6bbx"
server_key: "389fa4665e6745ebd69b8a0887efd79c"
server_key_iv: "9f47e13721b935c7e25f62c51c96e006"
server_key_version: "encryptionkey@0"
I20260807 20:00:01.173532 32393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:01.197175 32393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:01.198002 32393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:01.198325 32393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:01.199323 32393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:01.200918 32393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:01.201042 32393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:01.201160 32393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:01.201249 32393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:01.233630 32393 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:40725
I20260807 20:00:01.233692 32569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:40725 every 8 connection(s)
I20260807 20:00:01.234964 32393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 20:00:01.237980 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 32393
I20260807 20:00:01.238147 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 20:00:01.238584 5910 external_mini_cluster.cc:1428] Setting key 12b58e4c744d6fc1fcb1a022adc5fdb6
I20260807 20:00:01.241251 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39409
--builtin_ntp_servers=127.5.197.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:00:01.248127 32574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:01.237527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:49317 (local address 127.5.197.190:39409)
0807 20:00:01.238029 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:01.238036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:01.239375 (+ 1339us) server_negotiation.cc:407] Connection header received
0807 20:00:01.241225 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:01.241232 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:01.241318 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:01.241442 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:01.242616 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.243633 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.245311 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.245835 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.245950 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:01.247342 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:01.247347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:01.247351 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:01.247372 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:01.247423 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:01.247437 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:01.247515 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:01.247714 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 20:00:01.247813 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":255,"threads_started":1}
I20260807 20:00:01.249068 32575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:01.238181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39409 (local address 127.5.197.129:49317)
0807 20:00:01.239220 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:01.239266 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:01.240955 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:01.241742 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:01.241750 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:01.241843 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:01.242441 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:01.242458 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.243789 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.243793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:01.245155 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:01.245168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.246065 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.246073 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:01.246386 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:01.247031 (+ 645us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:01.247033 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:01.247080 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:01.247161 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:01.247523 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:01.247528 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:01.247533 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:00:01.247681 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 20:00:01.247981 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":293,"threads_started":1}
I20260807 20:00:01.250597 32570 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39409
I20260807 20:00:01.250885 32570 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:01.251616 32570 heartbeater.cc:511] Master 127.5.197.190:39409 requested a full tablet report, sending...
I20260807 20:00:01.253865 32319 ts_manager.cc:194] Registered new tserver with Master: e09095dde1a245a5952ab5f1aa4ca948 (127.5.197.129:40725)
I20260807 20:00:01.255524 32319 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.129:49317
W20260807 20:00:01.583768 32576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:01.584043 32576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:01.584165 32576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:01.591269 32576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:01.591373 32576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:01.591521 32576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 20:00:01.600543 32576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:01.601900 32576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:01.603772 32576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:01.616647 32582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:01.616758 32586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:01.616748 32584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:01.617822 32576 server_base.cc:1034] running on GCE node
I20260807 20:00:01.618487 32576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:01.619381 32576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:01.620571 32576 hybrid_clock.cc:648] HybridClock initialized: now 1786132801620514 us; error 41 us; skew 500 ppm
I20260807 20:00:01.620909 32576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:01.623132 32576 webserver.cc:460] Webserver started at http://127.5.197.130:33159/ using document root <none> and password file <none>
I20260807 20:00:01.623818 32576 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:01.623922 32576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:01.624239 32576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:01.627065 32576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "2277875d34324b78b94687ca9b956072"
format_stamp: "Formatted at 2026-08-07 20:00:01 on dist-test-slave-6bbx"
server_key: "38535e4def0adc522da7a5c2930df3bc"
server_key_iv: "dcd88912e08383405a32516d9d874506"
server_key_version: "encryptionkey@0"
I20260807 20:00:01.627871 32576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "2277875d34324b78b94687ca9b956072"
format_stamp: "Formatted at 2026-08-07 20:00:01 on dist-test-slave-6bbx"
server_key: "38535e4def0adc522da7a5c2930df3bc"
server_key_iv: "dcd88912e08383405a32516d9d874506"
server_key_version: "encryptionkey@0"
I20260807 20:00:01.632655 32576 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 20:00:01.636137 32594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:01.637398 32576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 20:00:01.637552 32576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "2277875d34324b78b94687ca9b956072"
format_stamp: "Formatted at 2026-08-07 20:00:01 on dist-test-slave-6bbx"
server_key: "38535e4def0adc522da7a5c2930df3bc"
server_key_iv: "dcd88912e08383405a32516d9d874506"
server_key_version: "encryptionkey@0"
I20260807 20:00:01.637761 32576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:01.650275 32576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:01.651036 32576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:01.651329 32576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:01.652261 32576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:01.653784 32576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:01.653889 32576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:01.654021 32576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:01.654095 32576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:01.684116 32576 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:41359
I20260807 20:00:01.684156 32748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:41359 every 8 connection(s)
I20260807 20:00:01.685636 32576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 20:00:01.694023 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 32576
I20260807 20:00:01.694200 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 20:00:01.694644 5910 external_mini_cluster.cc:1428] Setting key 12797467c520f678078d8fe8b927d996
I20260807 20:00:01.697522 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39409
--builtin_ntp_servers=127.5.197.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:00:01.698953 32574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:01.688381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:53171 (local address 127.5.197.190:39409)
0807 20:00:01.688549 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:01.688553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:01.690072 (+ 1519us) server_negotiation.cc:407] Connection header received
0807 20:00:01.691875 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:01.691881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:01.691965 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:01.692053 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:01.693103 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.693981 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.696320 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.696775 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.696892 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:01.698199 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:01.698204 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:01.698207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:01.698224 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:01.698263 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:01.698276 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:01.698350 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:01.698556 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 20:00:01.698654 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 20:00:01.699951 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:01.689007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39409 (local address 127.5.197.130:53171)
0807 20:00:01.689917 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:01.689951 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:01.691587 (+ 1636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:01.692302 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:01.692310 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:01.692395 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:01.692935 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:01.692952 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.694157 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.694163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:01.696123 (+ 1960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:01.696139 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:01.696995 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:01.697004 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:01.697218 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:01.697911 (+ 693us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:01.697914 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:01.697952 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:01.698025 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:01.698365 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:01.698376 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:01.698384 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 20:00:01.698530 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 20:00:01.698901 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":304,"threads_started":1}
I20260807 20:00:01.701268 32750 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39409
I20260807 20:00:01.701543 32750 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:01.702337 32750 heartbeater.cc:511] Master 127.5.197.190:39409 requested a full tablet report, sending...
I20260807 20:00:01.703778 32319 ts_manager.cc:194] Registered new tserver with Master: 2277875d34324b78b94687ca9b956072 (127.5.197.130:41359)
I20260807 20:00:01.704758 32319 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.130:53171
W20260807 20:00:02.034178 32753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:02.034439 32753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:02.034546 32753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:02.041790 32753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:02.041879 32753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:02.042024 32753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 20:00:02.050928 32753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:39409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:02.052158 32753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:02.053879 32753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:02.066425 32761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:02.066454 32760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:02.066591 32763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:02.067260 32753 server_base.cc:1034] running on GCE node
I20260807 20:00:02.067858 32753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:02.068765 32753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:02.069980 32753 hybrid_clock.cc:648] HybridClock initialized: now 1786132802069932 us; error 41 us; skew 500 ppm
I20260807 20:00:02.070286 32753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:02.072551 32753 webserver.cc:460] Webserver started at http://127.5.197.131:46041/ using document root <none> and password file <none>
I20260807 20:00:02.073211 32753 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:02.073314 32753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:02.073624 32753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:02.076516 32753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "c6ef20c07e73499ba9dd933454e1ddf7"
format_stamp: "Formatted at 2026-08-07 20:00:02 on dist-test-slave-6bbx"
server_key: "09dbdb77750eeabc06fb9f30a4d5483a"
server_key_iv: "fe331e2f75c1477efe4dce242fc6fcef"
server_key_version: "encryptionkey@0"
I20260807 20:00:02.077292 32753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "c6ef20c07e73499ba9dd933454e1ddf7"
format_stamp: "Formatted at 2026-08-07 20:00:02 on dist-test-slave-6bbx"
server_key: "09dbdb77750eeabc06fb9f30a4d5483a"
server_key_iv: "fe331e2f75c1477efe4dce242fc6fcef"
server_key_version: "encryptionkey@0"
I20260807 20:00:02.082425 32753 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 20:00:02.085879 301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:02.087129 32753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:02.087278 32753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "c6ef20c07e73499ba9dd933454e1ddf7"
format_stamp: "Formatted at 2026-08-07 20:00:02 on dist-test-slave-6bbx"
server_key: "09dbdb77750eeabc06fb9f30a4d5483a"
server_key_iv: "fe331e2f75c1477efe4dce242fc6fcef"
server_key_version: "encryptionkey@0"
I20260807 20:00:02.087476 32753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:02.098866 32753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:02.099588 32753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:02.099893 32753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:02.100809 32753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:02.102253 32753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:02.102349 32753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:02.102461 32753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:02.102530 32753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:02.134930 32753 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:37555
I20260807 20:00:02.135020 442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:37555 every 8 connection(s)
I20260807 20:00:02.136276 32753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 20:00:02.139603 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 32753
I20260807 20:00:02.139801 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 20:00:02.140393 5910 external_mini_cluster.cc:1428] Setting key 23f1f15d5f24c0962cd1b51a8eff6210
I20260807 20:00:02.148826 32574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.138719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:52333 (local address 127.5.197.190:39409)
0807 20:00:02.138909 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.138913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.140489 (+ 1576us) server_negotiation.cc:407] Connection header received
0807 20:00:02.142736 (+ 2247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.142742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.142828 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.142943 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:02.144094 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.144843 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.146403 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.146825 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.146924 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.148134 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:02.148139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:02.148142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:02.148159 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:02.148190 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:02.148202 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:02.148275 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.148513 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.148590 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 20:00:02.149717 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.139236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:39409 (local address 127.5.197.131:52333)
0807 20:00:02.140298 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.140344 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:02.142471 (+ 2127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:02.143101 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:02.143109 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:02.143211 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:02.143945 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.143965 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.144977 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.144981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.146286 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.146299 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.147007 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.147012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.147207 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.147845 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:02.147848 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:02.147891 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:02.147962 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:02.148298 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:02.148309 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:02.148317 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 20:00:02.148495 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 20:00:02.148759 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":297,"threads_started":1}
I20260807 20:00:02.150893 445 heartbeater.cc:347] Connected to a master server at 127.5.197.190:39409
I20260807 20:00:02.151132 445 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:02.151836 445 heartbeater.cc:511] Master 127.5.197.190:39409 requested a full tablet report, sending...
I20260807 20:00:02.153151 32319 ts_manager.cc:194] Registered new tserver with Master: c6ef20c07e73499ba9dd933454e1ddf7 (127.5.197.131:37555)
I20260807 20:00:02.154006 32319 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.131:52333
I20260807 20:00:02.155642 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:00:02.164887 32574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.159542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40912 (local address 127.5.197.190:39409)
0807 20:00:02.159760 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.159766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.160172 (+ 406us) server_negotiation.cc:407] Connection header received
0807 20:00:02.160295 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.160299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.160364 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.160438 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:02.160855 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.161505 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.162778 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.163170 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.163259 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.164386 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:02.164390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:02.164394 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:02.164409 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:02.164441 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:02.164452 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:02.164518 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.164601 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.164666 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 20:00:02.168507 32318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:00:02.175400 32318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:00:02.207577 459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.187489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41359 (local address 127.0.0.1:42834)
0807 20:00:02.188491 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.188548 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:02.188723 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:02.200129 (+ 11406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:02.200133 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:02.200160 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:02.201062 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.201081 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.202898 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.202903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.204838 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.204851 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.206685 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.206692 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.206867 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.206900 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:00:02.206965 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 20:00:02.207184 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"mutex_wait_us":72,"thread_start_us":810,"threads_started":1}
I20260807 20:00:02.207834 463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.188316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45960 (local address 127.5.197.129:40725)
0807 20:00:02.197223 (+ 8907us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.197243 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.199154 (+ 1911us) server_negotiation.cc:407] Connection header received
0807 20:00:02.199296 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.199303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.199567 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.199778 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:02.200583 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.202556 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.205473 (+ 2917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.206386 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.206512 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.206778 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.207277 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.207455 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8712,"thread_start_us":8593,"threads_started":1}
I20260807 20:00:02.207906 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.187695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42834 (local address 127.5.197.130:41359)
0807 20:00:02.199561 (+ 11866us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.199568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.199601 (+ 33us) server_negotiation.cc:407] Connection header received
0807 20:00:02.199728 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.199736 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.199932 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.200130 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:02.201288 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.202761 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.205061 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.206452 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.207142 (+ 690us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.207351 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.207419 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.207555 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11708,"thread_start_us":11545,"threads_started":1}
I20260807 20:00:02.207647 465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.187928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:37555 (local address 127.0.0.1:56002)
0807 20:00:02.198088 (+ 10160us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.198116 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:02.198254 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:02.199882 (+ 1628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:02.199887 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:02.199916 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:02.200829 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.200850 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.202480 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.202485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.205228 (+ 2743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.205244 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.206949 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.206956 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.207142 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.207171 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 20:00:02.207247 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 20:00:02.207358 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10011,"mutex_wait_us":114,"thread_start_us":10662,"threads_started":1}
I20260807 20:00:02.208300 464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.188778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56002 (local address 127.5.197.131:37555)
0807 20:00:02.199253 (+ 10475us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.199263 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.199299 (+ 36us) server_negotiation.cc:407] Connection header received
0807 20:00:02.199401 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.199408 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.199636 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.200528 (+ 892us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:02.201055 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.202350 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.205431 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.206773 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.206899 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.207147 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.207800 (+ 653us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.207954 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10315,"thread_start_us":10177,"threads_started":1}
I20260807 20:00:02.209100 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.187928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:45960)
0807 20:00:02.198871 (+ 10943us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.198895 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:02.199021 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:02.199803 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:02.199811 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:02.199840 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:02.200348 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.200361 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.202686 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.202691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.205228 (+ 2537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.205244 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.206581 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.206588 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.206780 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.206831 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 20:00:02.206963 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 20:00:02.208244 (+ 1281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10816,"mutex_wait_us":1113,"thread_start_us":8875,"threads_started":1}
I20260807 20:00:02.212404 32474 tablet_service.cc:1467] Processing CreateTablet for tablet c1290dcf38e8413b9758b63e5b13f023 (DEFAULT_TABLE table=test-table [id=5ae5f4bfa1634c98b57bb3233cfade96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:02.212486 32652 tablet_service.cc:1467] Processing CreateTablet for tablet c1290dcf38e8413b9758b63e5b13f023 (DEFAULT_TABLE table=test-table [id=5ae5f4bfa1634c98b57bb3233cfade96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:02.212486 360 tablet_service.cc:1467] Processing CreateTablet for tablet c1290dcf38e8413b9758b63e5b13f023 (DEFAULT_TABLE table=test-table [id=5ae5f4bfa1634c98b57bb3233cfade96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:02.213780 32474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1290dcf38e8413b9758b63e5b13f023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:02.213838 32652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1290dcf38e8413b9758b63e5b13f023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:02.213832 360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1290dcf38e8413b9758b63e5b13f023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:02.225127 466 tablet_bootstrap.cc:492] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: Bootstrap starting.
I20260807 20:00:02.228360 469 tablet_bootstrap.cc:492] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Bootstrap starting.
I20260807 20:00:02.229741 466 tablet_bootstrap.cc:654] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:02.231077 466 log.cc:824] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:02.231552 468 tablet_bootstrap.cc:492] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Bootstrap starting.
I20260807 20:00:02.231956 469 tablet_bootstrap.cc:654] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:02.233078 469 log.cc:824] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:02.235363 468 tablet_bootstrap.cc:654] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:02.234602 466 tablet_bootstrap.cc:492] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: No bootstrap required, opened a new log
I20260807 20:00:02.236562 466 ts_tablet_manager.cc:1397] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260807 20:00:02.236555 468 log.cc:824] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:02.241043 469 tablet_bootstrap.cc:492] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: No bootstrap required, opened a new log
I20260807 20:00:02.241391 469 ts_tablet_manager.cc:1397] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20260807 20:00:02.245719 468 tablet_bootstrap.cc:492] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: No bootstrap required, opened a new log
I20260807 20:00:02.246114 468 ts_tablet_manager.cc:1397] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.009s
I20260807 20:00:02.248498 466 raft_consensus.cc:348] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.248942 466 raft_consensus.cc:374] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:02.249039 466 raft_consensus.cc:729] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09095dde1a245a5952ab5f1aa4ca948, State: Initialized, Role: FOLLOWER
I20260807 20:00:02.249670 466 consensus_queue.cc:260] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.250797 32570 heartbeater.cc:503] Master 127.5.197.190:39409 was elected leader, sending a full tablet report...
I20260807 20:00:02.251425 466 ts_tablet_manager.cc:1428] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260807 20:00:02.252955 469 raft_consensus.cc:348] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.253391 469 raft_consensus.cc:374] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:02.253502 469 raft_consensus.cc:729] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ef20c07e73499ba9dd933454e1ddf7, State: Initialized, Role: FOLLOWER
I20260807 20:00:02.254105 469 consensus_queue.cc:260] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.254428 468 raft_consensus.cc:348] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.254899 468 raft_consensus.cc:374] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:02.255048 468 raft_consensus.cc:729] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2277875d34324b78b94687ca9b956072, State: Initialized, Role: FOLLOWER
I20260807 20:00:02.255245 445 heartbeater.cc:503] Master 127.5.197.190:39409 was elected leader, sending a full tablet report...
I20260807 20:00:02.255988 469 ts_tablet_manager.cc:1428] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
I20260807 20:00:02.255828 468 consensus_queue.cc:260] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.257085 32750 heartbeater.cc:503] Master 127.5.197.190:39409 was elected leader, sending a full tablet report...
I20260807 20:00:02.257639 468 ts_tablet_manager.cc:1428] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 20:00:02.259562 478 raft_consensus.cc:482] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:00:02.259859 478 raft_consensus.cc:504] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.261616 478 leader_election.cc:288] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2277875d34324b78b94687ca9b956072 (127.5.197.130:41359), e09095dde1a245a5952ab5f1aa4ca948 (127.5.197.129:40725)
I20260807 20:00:02.268431 463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.262190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:49567 (local address 127.5.197.129:40725)
0807 20:00:02.262365 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.262372 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.262392 (+ 20us) server_negotiation.cc:407] Connection header received
0807 20:00:02.262457 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.262463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.262543 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.262641 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:02.263215 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.264176 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.266551 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.267626 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.267811 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.267880 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.268122 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.268238 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 20:00:02.268673 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.261868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.5.197.131:49567)
0807 20:00:02.262059 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.262083 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:02.262226 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:02.262826 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:02.262830 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:02.262852 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:02.263050 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.263061 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.264312 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.264315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.266397 (+ 2082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.266412 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.267799 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.267805 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.267946 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.267972 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 20:00:02.268069 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 20:00:02.268212 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":93}
I20260807 20:00:02.268860 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.262500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:56943 (local address 127.5.197.130:41359)
0807 20:00:02.262669 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.262674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.262790 (+ 116us) server_negotiation.cc:407] Connection header received
0807 20:00:02.262950 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.262954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.263003 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.263069 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:02.263594 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.264499 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.266783 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.267955 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.268067 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.268128 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.268506 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.268630 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 20:00:02.268877 480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.262082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:41359 (local address 127.5.197.131:56943)
0807 20:00:02.262717 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.262734 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:02.262845 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:02.263109 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:02.263113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:02.263138 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:02.263447 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.263455 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.264631 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.264636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.266633 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:02.266643 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.268107 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.268114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:02.268334 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.268368 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 20:00:02.268457 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:00:02.268564 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":453,"threads_started":1}
I20260807 20:00:02.269670 32678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1290dcf38e8413b9758b63e5b13f023" candidate_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2277875d34324b78b94687ca9b956072" is_pre_election: true
I20260807 20:00:02.269668 32502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1290dcf38e8413b9758b63e5b13f023" candidate_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09095dde1a245a5952ab5f1aa4ca948" is_pre_election: true
I20260807 20:00:02.270107 32502 raft_consensus.cc:2454] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ef20c07e73499ba9dd933454e1ddf7 in term 0.
I20260807 20:00:02.270107 32678 raft_consensus.cc:2454] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ef20c07e73499ba9dd933454e1ddf7 in term 0.
I20260807 20:00:02.270709 303 leader_election.cc:302] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6ef20c07e73499ba9dd933454e1ddf7, e09095dde1a245a5952ab5f1aa4ca948; no voters:
I20260807 20:00:02.271060 478 raft_consensus.cc:2781] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:00:02.271188 478 raft_consensus.cc:482] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:00:02.271271 478 raft_consensus.cc:3037] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:02.273435 478 raft_consensus.cc:504] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.274008 478 leader_election.cc:288] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [CANDIDATE]: Term 1 election: Requested vote from peers 2277875d34324b78b94687ca9b956072 (127.5.197.130:41359), e09095dde1a245a5952ab5f1aa4ca948 (127.5.197.129:40725)
I20260807 20:00:02.274413 32678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1290dcf38e8413b9758b63e5b13f023" candidate_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2277875d34324b78b94687ca9b956072"
I20260807 20:00:02.274503 32502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1290dcf38e8413b9758b63e5b13f023" candidate_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09095dde1a245a5952ab5f1aa4ca948"
I20260807 20:00:02.274586 32678 raft_consensus.cc:3037] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:02.274688 32502 raft_consensus.cc:3037] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:02.277315 32502 raft_consensus.cc:2454] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ef20c07e73499ba9dd933454e1ddf7 in term 1.
I20260807 20:00:02.277319 32678 raft_consensus.cc:2454] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ef20c07e73499ba9dd933454e1ddf7 in term 1.
I20260807 20:00:02.277685 306 leader_election.cc:302] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2277875d34324b78b94687ca9b956072, c6ef20c07e73499ba9dd933454e1ddf7; no voters:
I20260807 20:00:02.277966 478 raft_consensus.cc:2781] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:02.278410 478 raft_consensus.cc:686] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 1 LEADER]: Becoming Leader. State: Replica: c6ef20c07e73499ba9dd933454e1ddf7, State: Running, Role: LEADER
I20260807 20:00:02.278872 478 consensus_queue.cc:237] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } }
I20260807 20:00:02.283463 32318 catalog_manager.cc:5495] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ef20c07e73499ba9dd933454e1ddf7 (127.5.197.131). New cstate: current_term: 1 leader_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6ef20c07e73499ba9dd933454e1ddf7" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 37555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 } health_report { overall_health: UNKNOWN } } }
I20260807 20:00:02.306504 464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.301700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56006 (local address 127.5.197.131:37555)
0807 20:00:02.301914 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.301921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.301942 (+ 21us) server_negotiation.cc:407] Connection header received
0807 20:00:02.302081 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.302085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.302179 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.302304 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:00:02.302589 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.303322 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.304674 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.305083 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.305172 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.305583 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:00:02.306062 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:00:02.306171 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.306207 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.306273 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 20:00:02.314289 32678 raft_consensus.cc:1261] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 1 FOLLOWER]: Refusing update from remote peer c6ef20c07e73499ba9dd933454e1ddf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:02.314289 32502 raft_consensus.cc:1261] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 1 FOLLOWER]: Refusing update from remote peer c6ef20c07e73499ba9dd933454e1ddf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:02.315310 481 consensus_queue.cc:1035] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2277875d34324b78b94687ca9b956072" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 41359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:02.315649 478 consensus_queue.cc:1035] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09095dde1a245a5952ab5f1aa4ca948" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 40725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:02.329339 485 mvcc.cc:205] Tried to move back new op lower bound from 7315999958269665280 to 7315999958138171392. Current Snapshot: MvccSnapshot[applied={T|T < 7315999958269665280}]
I20260807 20:00:02.339918 32318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:02.340142 32318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:02.343532 32318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be45d9651b36472fb115a4336b2045d1: Sending DeleteTablet for 3 replicas of tablet c1290dcf38e8413b9758b63e5b13f023
I20260807 20:00:02.344733 32652 tablet_service.cc:1514] Processing DeleteTablet for tablet c1290dcf38e8413b9758b63e5b13f023 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:02 UTC) from {username='slave'} at 127.0.0.1:42834
I20260807 20:00:02.344740 360 tablet_service.cc:1514] Processing DeleteTablet for tablet c1290dcf38e8413b9758b63e5b13f023 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:02 UTC) from {username='slave'} at 127.0.0.1:56002
I20260807 20:00:02.345499 32474 tablet_service.cc:1514] Processing DeleteTablet for tablet c1290dcf38e8413b9758b63e5b13f023 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:02 UTC) from {username='slave'} at 127.0.0.1:45960
I20260807 20:00:02.345758 499 tablet_replica.cc:330] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: stopping tablet replica
I20260807 20:00:02.346352 499 raft_consensus.cc:2229] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:02.346932 499 raft_consensus.cc:2258] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:02.349179 499 ts_tablet_manager.cc:1905] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:02.349632 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 32393
I20260807 20:00:02.356629 499 ts_tablet_manager.cc:1918] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:02.356699 501 tablet_replica.cc:330] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: stopping tablet replica
I20260807 20:00:02.356916 499 log.cc:1196] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/c1290dcf38e8413b9758b63e5b13f023
I20260807 20:00:02.357160 501 raft_consensus.cc:2229] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:02.357625 499 ts_tablet_manager.cc:1939] T c1290dcf38e8413b9758b63e5b13f023 P 2277875d34324b78b94687ca9b956072: Deleting consensus metadata
I20260807 20:00:02.357705 501 raft_consensus.cc:2258] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:02.359728 32301 catalog_manager.cc:4841] TS 2277875d34324b78b94687ca9b956072 (127.5.197.130:41359): tablet c1290dcf38e8413b9758b63e5b13f023 (table test-table [id=5ae5f4bfa1634c98b57bb3233cfade96]) successfully deleted
I20260807 20:00:02.362937 501 ts_tablet_manager.cc:1905] T c1290dcf38e8413b9758b63e5b13f023 P e09095dde1a245a5952ab5f1aa4ca948: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:02.363174 500 tablet_replica.cc:330] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: stopping tablet replica
I20260807 20:00:02.363603 500 raft_consensus.cc:2229] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:00:02.364282 500 raft_consensus.cc:2258] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:02.365641 463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.351336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45972 (local address 127.5.197.129:40725)
0807 20:00:02.352086 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.352093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.354336 (+ 2243us) server_negotiation.cc:407] Connection header received
0807 20:00:02.355151 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.355157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.355276 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.355353 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:02.358168 (+ 2815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.359381 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.361409 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.362067 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.362223 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.363475 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:02.363488 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:02.363503 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:02.364292 (+ 789us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:02.364373 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:02.364403 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:02.364525 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.365142 (+ 617us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.365260 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606}
I20260807 20:00:02.366488 32562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:02.366473 500 ts_tablet_manager.cc:1905] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:02.373361 500 ts_tablet_manager.cc:1918] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:02.373503 500 log.cc:1196] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/c1290dcf38e8413b9758b63e5b13f023
I20260807 20:00:02.373961 500 ts_tablet_manager.cc:1939] T c1290dcf38e8413b9758b63e5b13f023 P c6ef20c07e73499ba9dd933454e1ddf7: Deleting consensus metadata
I20260807 20:00:02.375384 32298 catalog_manager.cc:4841] TS c6ef20c07e73499ba9dd933454e1ddf7 (127.5.197.131:37555): tablet c1290dcf38e8413b9758b63e5b13f023 (table test-table [id=5ae5f4bfa1634c98b57bb3233cfade96]) successfully deleted
I20260807 20:00:02.491967 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 32393
W20260807 20:00:02.513689 32299 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.197.129:40725 (error 108)
I20260807 20:00:02.513909 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 32576
I20260807 20:00:02.515843 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.515299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:45980)
0807 20:00:02.515500 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.515636 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 20:00:02.516099 32299 catalog_manager.cc:4584] TS e09095dde1a245a5952ab5f1aa4ca948 (127.5.197.129:40725): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c1290dcf38e8413b9758b63e5b13f023: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
I20260807 20:00:02.521613 460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.515079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42842 (local address 127.5.197.130:41359)
0807 20:00:02.515292 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.515298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.515316 (+ 18us) server_negotiation.cc:407] Connection header received
0807 20:00:02.515387 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.515392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.515507 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.515601 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:02.516112 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.516952 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.518347 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.518785 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.518891 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.520131 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:02.520140 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:02.520154 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:02.520783 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:02.520835 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:02.520862 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:02.520960 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.521146 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.521284 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 20:00:02.522384 32743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:02.570076 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.569507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:45984)
0807 20:00:02.569764 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.569876 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 20:00:02.571341 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.570872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:45994)
0807 20:00:02.571040 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.571134 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 20:00:02.611253 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 32576
I20260807 20:00:02.632057 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.631429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:46002)
0807 20:00:02.631718 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.631841 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 20:00:02.633361 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.632876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:46016)
0807 20:00:02.633072 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.633169 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 20:00:02.636555 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 32753
I20260807 20:00:02.644579 464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.637352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56020 (local address 127.5.197.131:37555)
0807 20:00:02.637543 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:02.637549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:02.637575 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:00:02.637692 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:02.637698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:02.637835 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:02.637960 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:02.638361 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.639603 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.640891 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:02.641580 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:02.641710 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:02.642797 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:02.642809 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:02.642828 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:02.643764 (+ 936us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:02.643832 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:02.643859 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:02.643975 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:02.644093 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 20:00:02.644194 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 20:00:02.645313 436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:02.714596 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.714147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:46032)
0807 20:00:02.714348 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.714439 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 20:00:02.715822 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.715349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:46036)
0807 20:00:02.715532 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.715641 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 20:00:02.767807 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 32753
I20260807 20:00:02.795150 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 32275
I20260807 20:00:02.796319 32359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:02.906343 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 32275
I20260807 20:00:02.906422 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:02.905958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:40725 (local address 127.0.0.1:46048)
0807 20:00:02.906150 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:02.906250 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:40725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
2026-08-07T20:00:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2752 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:03 dist-test-slave-6bbx krb5kdc[510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:03 dist-test-slave-6bbx krb5kdc[510](info): set up 2 sockets
Aug 07 20:00:03 dist-test-slave-6bbx krb5kdc[510](info): commencing operation
krb5kdc: starting...
W20260807 20:00:04.130196 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:04 dist-test-slave-6bbx krb5kdc[510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:04.445060 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45083
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45083
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:04.787823 526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:04.788097 526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:04.788203 526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:04.795234 526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:04.795337 526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:04.795393 526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:04.795457 526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:04.795502 526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:04.805142 526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:04.806375 526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:04.807651 526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:04.819073 532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:04.819139 535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:04.819015 533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:04.819983 526 server_base.cc:1034] running on GCE node
I20260807 20:00:04.820775 526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:04.822101 526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:04.823319 526 hybrid_clock.cc:648] HybridClock initialized: now 1786132804823271 us; error 33 us; skew 500 ppm
I20260807 20:00:04.823652 526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:04 dist-test-slave-6bbx krb5kdc[510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132804, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:04.826660 526 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:04.828128 526 webserver.cc:460] Webserver started at http://127.5.197.190:38805/ using document root <none> and password file <none>
I20260807 20:00:04.828809 526 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:04.828929 526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:04.829224 526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:04.832199 526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "233e73d570614881b7dfcdda5b2d7914"
format_stamp: "Formatted at 2026-08-07 20:00:04 on dist-test-slave-6bbx"
server_key: "c2e7eff45ccab942bff5b75de95a6dad"
server_key_iv: "3483848fff2bc691ed4345bf306d3698"
server_key_version: "encryptionkey@0"
I20260807 20:00:04.832932 526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "233e73d570614881b7dfcdda5b2d7914"
format_stamp: "Formatted at 2026-08-07 20:00:04 on dist-test-slave-6bbx"
server_key: "c2e7eff45ccab942bff5b75de95a6dad"
server_key_iv: "3483848fff2bc691ed4345bf306d3698"
server_key_version: "encryptionkey@0"
I20260807 20:00:04.838008 526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 20:00:04.841596 545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:04.842859 526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:04.843020 526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "233e73d570614881b7dfcdda5b2d7914"
format_stamp: "Formatted at 2026-08-07 20:00:04 on dist-test-slave-6bbx"
server_key: "c2e7eff45ccab942bff5b75de95a6dad"
server_key_iv: "3483848fff2bc691ed4345bf306d3698"
server_key_version: "encryptionkey@0"
I20260807 20:00:04.843210 526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:04.861300 526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:04.865156 526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:04.865414 526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:04.882375 526 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:45083
I20260807 20:00:04.882405 619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:45083 every 8 connection(s)
I20260807 20:00:04.883659 526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:04.885360 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 526
I20260807 20:00:04.885533 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:04.886018 5910 external_mini_cluster.cc:1428] Setting key e8cdc5de76e0936895df9d77c3704787
I20260807 20:00:04.887737 620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 20:00:04 dist-test-slave-6bbx krb5kdc[510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:04.900972 620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914: Bootstrap starting.
I20260807 20:00:04.904517 620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:04.905591 620 log.cc:824] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:04.908829 620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914: No bootstrap required, opened a new log
I20260807 20:00:04.909792 625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:04.887979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50982 (local address 127.5.197.190:45083)
0807 20:00:04.888782 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:04.888793 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:04.888835 (+ 42us) server_negotiation.cc:407] Connection header received
0807 20:00:04.890470 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:04.890493 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:04.890887 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:04.891226 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:04.893176 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:04.894618 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:04.896461 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:04.897135 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:04.897324 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:04.902332 (+ 5008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:04.902341 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:04.902353 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:04.902390 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:04.905508 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:04.906406 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:04.906415 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:04.906428 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:04.906649 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:04.907023 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:04.907027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:04.907029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:04.907538 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:04.907817 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:04.908322 (+ 505us) server_negotiation.cc:299] Negotiation successful
0807 20:00:04.908700 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":359,"threads_started":1}
I20260807 20:00:04.916597 620 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233e73d570614881b7dfcdda5b2d7914" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45083 } }
I20260807 20:00:04.916958 620 raft_consensus.cc:374] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:04.917048 620 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233e73d570614881b7dfcdda5b2d7914, State: Initialized, Role: FOLLOWER
I20260807 20:00:04.917654 620 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233e73d570614881b7dfcdda5b2d7914" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45083 } }
I20260807 20:00:04.917904 620 raft_consensus.cc:388] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:04.918036 620 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:04.918195 620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:04.920318 620 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233e73d570614881b7dfcdda5b2d7914" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45083 } }
I20260807 20:00:04.920778 620 leader_election.cc:302] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 233e73d570614881b7dfcdda5b2d7914; no voters:
I20260807 20:00:04.921339 620 leader_election.cc:288] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:04.921459 627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:04.922078 627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [term 1 LEADER]: Becoming Leader. State: Replica: 233e73d570614881b7dfcdda5b2d7914, State: Running, Role: LEADER
I20260807 20:00:04.922663 627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233e73d570614881b7dfcdda5b2d7914" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45083 } }
I20260807 20:00:04.923256 620 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:04.925590 628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "233e73d570614881b7dfcdda5b2d7914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233e73d570614881b7dfcdda5b2d7914" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45083 } } }
I20260807 20:00:04.925552 629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233e73d570614881b7dfcdda5b2d7914. Latest consensus state: current_term: 1 leader_uuid: "233e73d570614881b7dfcdda5b2d7914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233e73d570614881b7dfcdda5b2d7914" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45083 } } }
I20260807 20:00:04.926007 629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:04.926011 628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:04.928336 636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:04.933367 636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:04.942260 636 catalog_manager.cc:1347] Generated new cluster ID: b2c7c613777d458f8214f35282b717a3
I20260807 20:00:04.942374 636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:04.976955 636 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:04.978374 636 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:04.985333 636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914: Generated new TSK 0
I20260807 20:00:04.986109 636 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 20:00:05.075598 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45083
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:05.445791 656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:05.446066 656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:05.446198 656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:05.453557 656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:05.453667 656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:05.453805 656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 20:00:05.463682 656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:05.464947 656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:05.466266 656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:05.479182 663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:05.479274 664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:05.479236 666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:05.479961 656 server_base.cc:1034] running on GCE node
I20260807 20:00:05.480579 656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:05.481493 656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:05.482693 656 hybrid_clock.cc:648] HybridClock initialized: now 1786132805482648 us; error 34 us; skew 500 ppm
I20260807 20:00:05.483031 656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:05 dist-test-slave-6bbx krb5kdc[510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132805, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:05.486398 656 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 20:00:05.487963 656 webserver.cc:460] Webserver started at http://127.5.197.129:43245/ using document root <none> and password file <none>
I20260807 20:00:05.488628 656 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:05.488750 656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:05.489053 656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:05.492008 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "7d4fef088f9b478483184f784831a18d"
format_stamp: "Formatted at 2026-08-07 20:00:05 on dist-test-slave-6bbx"
server_key: "0bb11719dde9f16ef63c36c604899500"
server_key_iv: "f7fd5bf787e13e723ee123304ad0020e"
server_key_version: "encryptionkey@0"
I20260807 20:00:05.492784 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "7d4fef088f9b478483184f784831a18d"
format_stamp: "Formatted at 2026-08-07 20:00:05 on dist-test-slave-6bbx"
server_key: "0bb11719dde9f16ef63c36c604899500"
server_key_iv: "f7fd5bf787e13e723ee123304ad0020e"
server_key_version: "encryptionkey@0"
I20260807 20:00:05.497884 656 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 20:00:05.501392 674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:05.502658 656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 20:00:05.502805 656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "7d4fef088f9b478483184f784831a18d"
format_stamp: "Formatted at 2026-08-07 20:00:05 on dist-test-slave-6bbx"
server_key: "0bb11719dde9f16ef63c36c604899500"
server_key_iv: "f7fd5bf787e13e723ee123304ad0020e"
server_key_version: "encryptionkey@0"
I20260807 20:00:05.502986 656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:05.518622 656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:05.522627 656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:05.522907 656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:05.523910 656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:05.525309 656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:05.525390 656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:05.525516 656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:05.525570 656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:05.556341 656 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:41753
I20260807 20:00:05.556385 813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:41753 every 8 connection(s)
I20260807 20:00:05.557715 656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 20:00:05.564494 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 656
I20260807 20:00:05.564666 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 20:00:05.565089 5910 external_mini_cluster.cc:1428] Setting key 219b3d33f7c3db44dc161cec2ea3bf2a
Aug 07 20:00:05 dist-test-slave-6bbx krb5kdc[510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132805, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:05.578271 817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:05.560418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:40265 (local address 127.5.197.190:45083)
0807 20:00:05.560978 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:05.560985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:05.561929 (+ 944us) server_negotiation.cc:407] Connection header received
0807 20:00:05.563781 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:05.563785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:05.563855 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:05.563954 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:05.565536 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:05.566294 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:05.568141 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:05.568682 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:05.568828 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:05.572263 (+ 3435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:05.572270 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:05.572274 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:05.572313 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:05.575231 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:05.575982 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:05.575986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:05.575988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:05.576114 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:05.576547 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:05.576551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:05.576553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:05.576822 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:05.576956 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:05.577680 (+ 724us) server_negotiation.cc:299] Negotiation successful
0807 20:00:05.577911 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":274,"threads_started":1}
I20260807 20:00:05.579303 818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:05.560975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45083 (local address 127.5.197.129:40265)
0807 20:00:05.561753 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:05.561798 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:05.563478 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:05.564166 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:05.564174 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:05.564747 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:05.565352 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:05.565372 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:05.566470 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:05.566475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:05.567995 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:05.568009 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:05.568899 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:05.568905 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:05.569116 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:05.569768 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:05.569791 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:05.572035 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:05.575378 (+ 3343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:05.575386 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:05.575398 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:05.575863 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:05.576230 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:05.576233 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:05.576236 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:05.576424 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:05.576956 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:05.576964 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:05.577285 (+ 321us) client_negotiation.cc:769] Sending connection context
0807 20:00:05.577525 (+ 240us) client_negotiation.cc:240] Negotiation successful
0807 20:00:05.578055 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":313,"threads_started":1}
I20260807 20:00:05.580942 814 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45083
I20260807 20:00:05.581264 814 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:05.582191 814 heartbeater.cc:511] Master 127.5.197.190:45083 requested a full tablet report, sending...
I20260807 20:00:05.584712 570 ts_manager.cc:194] Registered new tserver with Master: 7d4fef088f9b478483184f784831a18d (127.5.197.129:41753)
I20260807 20:00:05.586658 570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:40265
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 20:00:05.637851 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45083
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:05.976326 822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:05.976639 822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:05.976768 822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:05.983847 822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:05.983955 822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:05.984066 822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 20:00:05.993827 822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:05.995040 822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:05.996393 822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:06.010130 830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:06.010300 833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:06.010257 829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:06.010939 822 server_base.cc:1034] running on GCE node
I20260807 20:00:06.011555 822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:06.012524 822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:06.013720 822 hybrid_clock.cc:648] HybridClock initialized: now 1786132806013660 us; error 51 us; skew 500 ppm
I20260807 20:00:06.014014 822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:06 dist-test-slave-6bbx krb5kdc[510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132806, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:06.021817 822 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 20:00:06.023651 822 webserver.cc:460] Webserver started at http://127.5.197.130:41787/ using document root <none> and password file <none>
I20260807 20:00:06.024403 822 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:06.024513 822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:06.024785 822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:06.027750 822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "626b85a21f504018bbb0b1ee2c4a85b0"
format_stamp: "Formatted at 2026-08-07 20:00:06 on dist-test-slave-6bbx"
server_key: "e2b35959960557a3adb66ca3d7fc164e"
server_key_iv: "7621a53da39f29b52f0724f0697da655"
server_key_version: "encryptionkey@0"
I20260807 20:00:06.028492 822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "626b85a21f504018bbb0b1ee2c4a85b0"
format_stamp: "Formatted at 2026-08-07 20:00:06 on dist-test-slave-6bbx"
server_key: "e2b35959960557a3adb66ca3d7fc164e"
server_key_iv: "7621a53da39f29b52f0724f0697da655"
server_key_version: "encryptionkey@0"
I20260807 20:00:06.033494 822 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 20:00:06.036895 841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:06.038143 822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:06.038275 822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "626b85a21f504018bbb0b1ee2c4a85b0"
format_stamp: "Formatted at 2026-08-07 20:00:06 on dist-test-slave-6bbx"
server_key: "e2b35959960557a3adb66ca3d7fc164e"
server_key_iv: "7621a53da39f29b52f0724f0697da655"
server_key_version: "encryptionkey@0"
I20260807 20:00:06.038486 822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:06.056416 822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:06.060523 822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:06.060796 822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:06.061761 822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:06.063086 822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:06.063158 822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:06.063278 822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:06.063336 822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:06.095103 822 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:45883
I20260807 20:00:06.095152 1002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:45883 every 8 connection(s)
I20260807 20:00:06.096477 822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 20:00:06.098807 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 822
I20260807 20:00:06.098999 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 20:00:06.099509 5910 external_mini_cluster.cc:1428] Setting key c8997373bc2f7d89879c4689fdd63c64
Aug 07 20:00:06 dist-test-slave-6bbx krb5kdc[510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132806, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:06.118441 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.099002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:40455 (local address 127.5.197.190:45083)
0807 20:00:06.099456 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.099462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.100611 (+ 1149us) server_negotiation.cc:407] Connection header received
0807 20:00:06.102998 (+ 2387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.103002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.103064 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.103152 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:06.105230 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.105967 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.108076 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.108493 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.108587 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.112623 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:06.112628 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:06.112631 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:06.112665 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:06.115134 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.115999 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.116003 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.116005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.116145 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.116647 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.116652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.116655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.117006 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:06.117147 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.117867 (+ 720us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.118089 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":206,"threads_started":1}
I20260807 20:00:06.119264 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.099591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45083 (local address 127.5.197.130:40455)
0807 20:00:06.100435 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:06.100485 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:06.102712 (+ 2227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:06.103436 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:06.103448 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:06.104238 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:06.105066 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.105091 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.106159 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.106164 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.107932 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.107948 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.108723 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.108730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.108993 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.109669 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:06.109701 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:06.112364 (+ 2663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:06.115294 (+ 2930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:06.115303 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:06.115318 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:06.115882 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:06.116253 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:06.116257 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:06.116259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:06.116532 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:06.117113 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:06.117119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:06.117491 (+ 372us) client_negotiation.cc:769] Sending connection context
0807 20:00:06.117713 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 20:00:06.118097 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":317,"threads_started":1}
I20260807 20:00:06.120779 1003 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45083
I20260807 20:00:06.121068 1003 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:06.121788 1003 heartbeater.cc:511] Master 127.5.197.190:45083 requested a full tablet report, sending...
I20260807 20:00:06.123284 570 ts_manager.cc:194] Registered new tserver with Master: 626b85a21f504018bbb0b1ee2c4a85b0 (127.5.197.130:45883)
I20260807 20:00:06.124190 570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:40455
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 20:00:06.170674 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45083
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:06.505513 1010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:06.505789 1010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:06.505898 1010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:06.513064 1010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:06.513166 1010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:06.513275 1010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 20:00:06.522611 1010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:06.523921 1010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:06.525238 1010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:06.537935 1018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:06.537971 1021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:06.537906 1019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:06.538738 1010 server_base.cc:1034] running on GCE node
I20260807 20:00:06.539352 1010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:06.540356 1010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:06.541549 1010 hybrid_clock.cc:648] HybridClock initialized: now 1786132806541488 us; error 43 us; skew 500 ppm
I20260807 20:00:06.541883 1010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:06 dist-test-slave-6bbx krb5kdc[510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132806, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:06.545202 1010 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 20:00:06.546674 1010 webserver.cc:460] Webserver started at http://127.5.197.131:46657/ using document root <none> and password file <none>
I20260807 20:00:06.547394 1010 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:06.547515 1010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:06.547876 1010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:06.550776 1010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "b8e9cf5f7e224bdea3217d1b4c834d23"
format_stamp: "Formatted at 2026-08-07 20:00:06 on dist-test-slave-6bbx"
server_key: "1abb8705a3ba7949f39676f5f70c33ee"
server_key_iv: "7c14a297a425e3591edd37f7b41373cb"
server_key_version: "encryptionkey@0"
I20260807 20:00:06.551568 1010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "b8e9cf5f7e224bdea3217d1b4c834d23"
format_stamp: "Formatted at 2026-08-07 20:00:06 on dist-test-slave-6bbx"
server_key: "1abb8705a3ba7949f39676f5f70c33ee"
server_key_iv: "7c14a297a425e3591edd37f7b41373cb"
server_key_version: "encryptionkey@0"
I20260807 20:00:06.556802 1010 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 20:00:06.560448 1031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:06.561796 1010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:06.561965 1010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "b8e9cf5f7e224bdea3217d1b4c834d23"
format_stamp: "Formatted at 2026-08-07 20:00:06 on dist-test-slave-6bbx"
server_key: "1abb8705a3ba7949f39676f5f70c33ee"
server_key_iv: "7c14a297a425e3591edd37f7b41373cb"
server_key_version: "encryptionkey@0"
I20260807 20:00:06.562176 1010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:06.577363 1010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:06.581837 1010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:06.582134 1010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:06.583191 1010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:06.584712 1010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:06.584811 1010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:06.584930 1010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:06.584982 1010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:06.589788 814 heartbeater.cc:503] Master 127.5.197.190:45083 was elected leader, sending a full tablet report...
I20260807 20:00:06.615705 1010 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:46051
I20260807 20:00:06.615759 1196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:46051 every 8 connection(s)
I20260807 20:00:06.617112 1010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 20:00:06.622356 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 1010
I20260807 20:00:06.622516 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 20:00:06.622967 5910 external_mini_cluster.cc:1428] Setting key 3091ad2f89905363d9bc5cdfdd2619c4
Aug 07 20:00:06 dist-test-slave-6bbx krb5kdc[510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132806, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:06.637650 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.619765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:47303 (local address 127.5.197.190:45083)
0807 20:00:06.620276 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.620283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.621364 (+ 1081us) server_negotiation.cc:407] Connection header received
0807 20:00:06.623323 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.623328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.623418 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.623516 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:06.625166 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.625954 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.627559 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.628003 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.628118 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.631400 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:06.631406 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:06.631409 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:06.631447 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:06.634496 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.635197 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.635202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.635204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.635383 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.635824 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.635830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.635833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.636108 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:06.636252 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.637024 (+ 772us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.637240 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":218,"threads_started":1}
I20260807 20:00:06.638551 1201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.620341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45083 (local address 127.5.197.131:47303)
0807 20:00:06.621135 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:06.621231 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:06.623011 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:06.623839 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:06.623848 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:06.624401 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:06.624998 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.625016 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.626116 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.626120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.627421 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.627434 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.628234 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.628242 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.628456 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.629075 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:06.629098 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:06.631195 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:06.634606 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:06.634612 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:06.634622 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:06.635021 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:06.635486 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:06.635489 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:06.635491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:06.635696 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:06.636237 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:06.636244 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:06.636616 (+ 372us) client_negotiation.cc:769] Sending connection context
0807 20:00:06.636893 (+ 277us) client_negotiation.cc:240] Negotiation successful
0807 20:00:06.637377 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":333,"threads_started":1}
I20260807 20:00:06.639870 1197 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45083
I20260807 20:00:06.640172 1197 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:06.640898 1197 heartbeater.cc:511] Master 127.5.197.190:45083 requested a full tablet report, sending...
I20260807 20:00:06.642288 570 ts_manager.cc:194] Registered new tserver with Master: b8e9cf5f7e224bdea3217d1b4c834d23 (127.5.197.131:46051)
I20260807 20:00:06.643123 570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:47303
I20260807 20:00:06.650143 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:00:06.668291 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.654361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50996 (local address 127.5.197.190:45083)
0807 20:00:06.654534 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.654540 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.655053 (+ 513us) server_negotiation.cc:407] Connection header received
0807 20:00:06.655318 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.655324 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.655406 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.655485 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:06.657365 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.658273 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.659690 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.660085 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.660209 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.662920 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:06.662925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:06.662928 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:06.662959 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:06.665446 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.666225 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.666229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.666231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.666375 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.666808 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.666813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.666816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.667110 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:06.667362 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.667806 (+ 444us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.667988 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 20:00:06.672092 570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:00:06.679003 570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:00:06.705382 1217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.690657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:45883 (local address 127.0.0.1:34354)
0807 20:00:06.696984 (+ 6327us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:06.697002 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:06.697208 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:06.698042 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:06.698050 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:06.698081 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:06.698538 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.698552 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.700517 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.700527 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.702632 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.702644 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.704442 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.704449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.704650 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.704703 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 20:00:06.704835 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 20:00:06.705018 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6206,"thread_start_us":6066,"threads_started":1}
I20260807 20:00:06.705413 1218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.691189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34354 (local address 127.5.197.130:45883)
0807 20:00:06.691874 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.691883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.697103 (+ 5220us) server_negotiation.cc:407] Connection header received
0807 20:00:06.697423 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.697430 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.697606 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.697733 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:06.698756 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.700345 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.702787 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.704116 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.704248 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.704446 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.704910 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.705079 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":344,"threads_started":1}
I20260807 20:00:06.707116 1221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.697482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36144 (local address 127.5.197.131:46051)
0807 20:00:06.698251 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.698258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.699179 (+ 921us) server_negotiation.cc:407] Connection header received
0807 20:00:06.699388 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.699393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.699572 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.699772 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:06.700796 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.701812 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.704460 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.705676 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.705758 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.705955 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.706622 (+ 667us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.706776 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":437,"threads_started":1}
I20260807 20:00:06.707219 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.698260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:46051 (local address 127.0.0.1:36144)
0807 20:00:06.699058 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:06.699072 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:06.699187 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:06.700095 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:06.700099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:06.700122 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:06.700580 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.700593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.701962 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.701968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.704260 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.704277 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.706191 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.706198 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.706435 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.706475 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 20:00:06.706554 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 20:00:06.706732 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":72,"thread_start_us":562,"threads_started":1}
I20260807 20:00:06.707858 1216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.690609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46142 (local address 127.5.197.129:41753)
0807 20:00:06.698780 (+ 8171us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.698788 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.698827 (+ 39us) server_negotiation.cc:407] Connection header received
0807 20:00:06.698924 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.698931 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.699164 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.700236 (+ 1072us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:06.700471 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.702044 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.704557 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.705907 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.706194 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.706413 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.707366 (+ 953us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.707525 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7993,"thread_start_us":7848,"threads_started":1}
I20260807 20:00:06.707259 1214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.690400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:41753 (local address 127.0.0.1:46142)
0807 20:00:06.696204 (+ 5804us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:06.696240 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:06.696415 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:06.699554 (+ 3139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:06.699559 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:06.699585 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:06.700052 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.700064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.702192 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.702197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.704392 (+ 2195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.704405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.706219 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.706231 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.706442 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.706483 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 20:00:06.706561 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 20:00:06.706815 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5583,"mutex_wait_us":48,"thread_start_us":5438,"threads_started":1}
I20260807 20:00:06.710037 904 tablet_service.cc:1467] Processing CreateTablet for tablet 45d2218e12d94c688ccb0c075358d864 (DEFAULT_TABLE table=test-table [id=2cdb0e18a22148b993f2d884a1f465f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:06.711621 904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d2218e12d94c688ccb0c075358d864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:06.711709 1108 tablet_service.cc:1467] Processing CreateTablet for tablet 45d2218e12d94c688ccb0c075358d864 (DEFAULT_TABLE table=test-table [id=2cdb0e18a22148b993f2d884a1f465f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:06.712481 732 tablet_service.cc:1467] Processing CreateTablet for tablet 45d2218e12d94c688ccb0c075358d864 (DEFAULT_TABLE table=test-table [id=2cdb0e18a22148b993f2d884a1f465f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:06.713340 1108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d2218e12d94c688ccb0c075358d864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:06.713827 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d2218e12d94c688ccb0c075358d864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:06.724362 1223 tablet_bootstrap.cc:492] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Bootstrap starting.
I20260807 20:00:06.728458 1224 tablet_bootstrap.cc:492] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Bootstrap starting.
I20260807 20:00:06.728526 1223 tablet_bootstrap.cc:654] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:06.730016 1225 tablet_bootstrap.cc:492] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Bootstrap starting.
I20260807 20:00:06.730005 1223 log.cc:824] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:06.731909 1224 tablet_bootstrap.cc:654] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:06.733251 1224 log.cc:824] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:06.733507 1225 tablet_bootstrap.cc:654] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:06.733664 1223 tablet_bootstrap.cc:492] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: No bootstrap required, opened a new log
I20260807 20:00:06.733986 1223 ts_tablet_manager.cc:1397] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 20:00:06.734515 1225 log.cc:824] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:06.740497 1224 tablet_bootstrap.cc:492] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: No bootstrap required, opened a new log
I20260807 20:00:06.740732 1225 tablet_bootstrap.cc:492] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: No bootstrap required, opened a new log
I20260807 20:00:06.740782 1224 ts_tablet_manager.cc:1397] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260807 20:00:06.741004 1225 ts_tablet_manager.cc:1397] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260807 20:00:06.744658 1223 raft_consensus.cc:348] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.745136 1223 raft_consensus.cc:374] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:06.745244 1223 raft_consensus.cc:729] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d4fef088f9b478483184f784831a18d, State: Initialized, Role: FOLLOWER
I20260807 20:00:06.745911 1223 consensus_queue.cc:260] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.748880 1224 raft_consensus.cc:348] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.749236 1224 raft_consensus.cc:374] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:06.749341 1224 raft_consensus.cc:729] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 626b85a21f504018bbb0b1ee2c4a85b0, State: Initialized, Role: FOLLOWER
I20260807 20:00:06.749895 1224 consensus_queue.cc:260] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.751796 1225 raft_consensus.cc:348] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.752279 1225 raft_consensus.cc:374] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:06.752383 1225 raft_consensus.cc:729] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8e9cf5f7e224bdea3217d1b4c834d23, State: Initialized, Role: FOLLOWER
I20260807 20:00:06.752954 1225 consensus_queue.cc:260] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.754254 1223 ts_tablet_manager.cc:1428] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Time spent starting tablet: real 0.020s user 0.013s sys 0.008s
I20260807 20:00:06.755255 1003 heartbeater.cc:503] Master 127.5.197.190:45083 was elected leader, sending a full tablet report...
I20260807 20:00:06.755887 1224 ts_tablet_manager.cc:1428] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Time spent starting tablet: real 0.015s user 0.007s sys 0.009s
I20260807 20:00:06.757295 1197 heartbeater.cc:503] Master 127.5.197.190:45083 was elected leader, sending a full tablet report...
I20260807 20:00:06.757913 1225 ts_tablet_manager.cc:1428] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Time spent starting tablet: real 0.017s user 0.011s sys 0.006s
I20260807 20:00:06.777161 1232 raft_consensus.cc:482] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:00:06.777417 1232 raft_consensus.cc:504] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.778987 1232 leader_election.cc:288] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d4fef088f9b478483184f784831a18d (127.5.197.129:41753), b8e9cf5f7e224bdea3217d1b4c834d23 (127.5.197.131:46051)
I20260807 20:00:06.787861 1216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.779460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:38675 (local address 127.5.197.129:41753)
0807 20:00:06.779687 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.779695 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.780415 (+ 720us) server_negotiation.cc:407] Connection header received
0807 20:00:06.780608 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.780613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.780687 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.780782 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:06.781487 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.782595 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.785608 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.786827 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.786979 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.787047 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.787452 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.787578 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 20:00:06.787858 1221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.779511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:56633 (local address 127.5.197.131:46051)
0807 20:00:06.779700 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.779706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.780415 (+ 709us) server_negotiation.cc:407] Connection header received
0807 20:00:06.780608 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.780613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.780687 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.780782 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:06.781487 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.782619 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.785612 (+ 2993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.786811 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.786972 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.787047 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.787452 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.787579 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 20:00:06.788182 1236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.779291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:46051 (local address 127.5.197.130:56633)
0807 20:00:06.780284 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:06.780317 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:06.780471 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:06.780803 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:06.780808 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:06.780840 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:06.781357 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.781367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.782724 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.782728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.785443 (+ 2715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.785459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.787056 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.787062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.787272 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.787333 (+ 61us) client_negotiation.cc:769] Sending connection context
0807 20:00:06.787415 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 20:00:06.787631 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"mutex_wait_us":334,"spinlock_wait_cycles":1792,"thread_start_us":631,"threads_started":1}
I20260807 20:00:06.788380 1235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.779333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:41753 (local address 127.5.197.130:38675)
0807 20:00:06.780303 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:06.780317 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:06.780471 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:06.780804 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:06.780819 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:06.780847 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:06.781328 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.781347 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.782721 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.782726 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.785451 (+ 2725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:06.785460 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.787050 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.787056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:06.787268 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.787321 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 20:00:06.787415 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 20:00:06.787631 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":193,"spinlock_wait_cycles":44032,"thread_start_us":565,"threads_started":1}
I20260807 20:00:06.789215 1136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d2218e12d94c688ccb0c075358d864" candidate_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" is_pre_election: true
I20260807 20:00:06.789567 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d2218e12d94c688ccb0c075358d864" candidate_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d4fef088f9b478483184f784831a18d" is_pre_election: true
I20260807 20:00:06.789680 1136 raft_consensus.cc:2454] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 626b85a21f504018bbb0b1ee2c4a85b0 in term 0.
I20260807 20:00:06.790009 754 raft_consensus.cc:2454] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 626b85a21f504018bbb0b1ee2c4a85b0 in term 0.
I20260807 20:00:06.790278 843 leader_election.cc:302] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 626b85a21f504018bbb0b1ee2c4a85b0, b8e9cf5f7e224bdea3217d1b4c834d23; no voters:
I20260807 20:00:06.790702 1232 raft_consensus.cc:2781] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:00:06.790865 1232 raft_consensus.cc:482] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:00:06.790970 1232 raft_consensus.cc:3037] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:06.793205 1232 raft_consensus.cc:504] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.793746 1232 leader_election.cc:288] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [CANDIDATE]: Term 1 election: Requested vote from peers 7d4fef088f9b478483184f784831a18d (127.5.197.129:41753), b8e9cf5f7e224bdea3217d1b4c834d23 (127.5.197.131:46051)
I20260807 20:00:06.794135 754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d2218e12d94c688ccb0c075358d864" candidate_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d4fef088f9b478483184f784831a18d"
I20260807 20:00:06.794195 1136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d2218e12d94c688ccb0c075358d864" candidate_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23"
I20260807 20:00:06.794329 754 raft_consensus.cc:3037] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:06.794355 1136 raft_consensus.cc:3037] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:06.796715 1136 raft_consensus.cc:2454] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 626b85a21f504018bbb0b1ee2c4a85b0 in term 1.
I20260807 20:00:06.797062 754 raft_consensus.cc:2454] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 626b85a21f504018bbb0b1ee2c4a85b0 in term 1.
I20260807 20:00:06.797057 843 leader_election.cc:302] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 626b85a21f504018bbb0b1ee2c4a85b0, b8e9cf5f7e224bdea3217d1b4c834d23; no voters:
I20260807 20:00:06.797344 1232 raft_consensus.cc:2781] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:06.797817 1232 raft_consensus.cc:686] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 1 LEADER]: Becoming Leader. State: Replica: 626b85a21f504018bbb0b1ee2c4a85b0, State: Running, Role: LEADER
I20260807 20:00:06.798295 1232 consensus_queue.cc:237] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } }
I20260807 20:00:06.802487 570 catalog_manager.cc:5495] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 626b85a21f504018bbb0b1ee2c4a85b0 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "626b85a21f504018bbb0b1ee2c4a85b0" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 45883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 } health_report { overall_health: UNKNOWN } } }
W20260807 20:00:06.810027 815 tablet.cc:2369] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:06.833370 1218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.828257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.5.197.130:45883)
0807 20:00:06.828470 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.828477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.828565 (+ 88us) server_negotiation.cc:407] Connection header received
0807 20:00:06.828753 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.828757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.828843 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.828962 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:00:06.829356 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.830082 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.831364 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.831801 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.831890 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.832360 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:00:06.832839 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:00:06.832964 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.833048 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.833086 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 20:00:06.841562 1136 raft_consensus.cc:1261] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 1 FOLLOWER]: Refusing update from remote peer 626b85a21f504018bbb0b1ee2c4a85b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:06.841586 754 raft_consensus.cc:1261] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 1 FOLLOWER]: Refusing update from remote peer 626b85a21f504018bbb0b1ee2c4a85b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:06.842569 1232 consensus_queue.cc:1035] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8e9cf5f7e224bdea3217d1b4c834d23" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:06.842906 1237 consensus_queue.cc:1035] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d4fef088f9b478483184f784831a18d" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 20:00:06.848320 1004 tablet.cc:2369] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:06.861910 1241 mvcc.cc:205] Tried to move back new op lower bound from 7315999976813465600 to 7315999976649392128. Current Snapshot: MvccSnapshot[applied={T|T < 7315999976813465600}]
I20260807 20:00:06.871732 570 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:06.872025 570 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:06.875918 570 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 233e73d570614881b7dfcdda5b2d7914: Sending DeleteTablet for 3 replicas of tablet 45d2218e12d94c688ccb0c075358d864
I20260807 20:00:06.876940 732 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d2218e12d94c688ccb0c075358d864 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:06 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:46142
I20260807 20:00:06.877152 1108 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d2218e12d94c688ccb0c075358d864 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:06 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:36144
I20260807 20:00:06.878067 904 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d2218e12d94c688ccb0c075358d864 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:06 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:34354
I20260807 20:00:06.880290 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 656
I20260807 20:00:06.887928 1254 tablet_replica.cc:330] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: stopping tablet replica
I20260807 20:00:06.888540 1255 tablet_replica.cc:330] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: stopping tablet replica
I20260807 20:00:06.889676 1255 raft_consensus.cc:2229] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:00:06.890321 1254 raft_consensus.cc:2229] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:06.891585 1255 raft_consensus.cc:2258] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:06.892232 1254 raft_consensus.cc:2258] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:06.895879 1255 ts_tablet_manager.cc:1905] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 20:00:06 dist-test-slave-6bbx krb5kdc[510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 20:00:06.904276 1253 tablet_replica.cc:330] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: stopping tablet replica
I20260807 20:00:06.904728 1253 raft_consensus.cc:2229] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:06.905297 1253 raft_consensus.cc:2258] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:06.905565 1254 ts_tablet_manager.cc:1905] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:06.905992 1255 ts_tablet_manager.cc:1918] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:06.906232 1255 log.cc:1196] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/45d2218e12d94c688ccb0c075358d864
I20260807 20:00:06.906955 1255 ts_tablet_manager.cc:1939] T 45d2218e12d94c688ccb0c075358d864 P 626b85a21f504018bbb0b1ee2c4a85b0: Deleting consensus metadata
I20260807 20:00:06.907215 1253 ts_tablet_manager.cc:1905] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:06.909049 547 catalog_manager.cc:4841] TS 626b85a21f504018bbb0b1ee2c4a85b0 (127.5.197.130:45883): tablet 45d2218e12d94c688ccb0c075358d864 (table test-table [id=2cdb0e18a22148b993f2d884a1f465f9]) successfully deleted
I20260807 20:00:06.913283 1254 ts_tablet_manager.cc:1918] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:06.913455 1254 log.cc:1196] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/45d2218e12d94c688ccb0c075358d864
I20260807 20:00:06.913981 1254 ts_tablet_manager.cc:1939] T 45d2218e12d94c688ccb0c075358d864 P b8e9cf5f7e224bdea3217d1b4c834d23: Deleting consensus metadata
I20260807 20:00:06.914317 1253 ts_tablet_manager.cc:1918] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:06.914517 1253 log.cc:1196] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/45d2218e12d94c688ccb0c075358d864
I20260807 20:00:06.915025 1253 ts_tablet_manager.cc:1939] T 45d2218e12d94c688ccb0c075358d864 P 7d4fef088f9b478483184f784831a18d: Deleting consensus metadata
I20260807 20:00:06.915824 547 catalog_manager.cc:4841] TS b8e9cf5f7e224bdea3217d1b4c834d23 (127.5.197.131:46051): tablet 45d2218e12d94c688ccb0c075358d864 (table test-table [id=2cdb0e18a22148b993f2d884a1f465f9]) successfully deleted
I20260807 20:00:06.916777 546 catalog_manager.cc:4841] TS 7d4fef088f9b478483184f784831a18d (127.5.197.129:41753): tablet 45d2218e12d94c688ccb0c075358d864 (table test-table [id=2cdb0e18a22148b993f2d884a1f465f9]) successfully deleted
I20260807 20:00:06.917888 1216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:06.883643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46150 (local address 127.5.197.129:41753)
0807 20:00:06.883857 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:06.883864 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:06.892812 (+ 8948us) server_negotiation.cc:407] Connection header received
0807 20:00:06.893318 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:06.893325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:06.893420 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:06.893497 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:06.895361 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.896585 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.898491 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:06.899099 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:06.899194 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:06.909524 (+ 10330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:06.909539 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:06.909556 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:06.909598 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:06.913683 (+ 4085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.914884 (+ 1201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.914893 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.914897 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.915078 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:06.916048 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:06.916053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:06.916056 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:06.916475 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:06.916741 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:06.917325 (+ 584us) server_negotiation.cc:299] Negotiation successful
0807 20:00:06.917541 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 20:00:06.918529 807 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:07.007965 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 656
I20260807 20:00:07.043653 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 822
Aug 07 20:00:07 dist-test-slave-6bbx krb5kdc[510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 20:00:07.061273 1218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:07.044465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34380 (local address 127.5.197.130:45883)
0807 20:00:07.044641 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:07.044645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:07.044710 (+ 65us) server_negotiation.cc:407] Connection header received
0807 20:00:07.044892 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:07.044896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:07.044987 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:07.045073 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:07.046844 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:07.047773 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:07.049600 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:07.050047 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:07.050140 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:07.055096 (+ 4956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:07.055111 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:07.055127 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:07.055170 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:07.058255 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:07.059004 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:07.059012 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:07.059014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:07.059161 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:07.059584 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:07.059590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:07.059594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:07.060101 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:07.060475 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:07.060629 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 20:00:07.060861 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 20:00:07.062027 994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:07.177616 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 822
I20260807 20:00:07.204100 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 1010
Aug 07 20:00:07 dist-test-slave-6bbx krb5kdc[510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 20:00:07.218544 1221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:07.204874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36158 (local address 127.5.197.131:46051)
0807 20:00:07.205063 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:07.205068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:07.205086 (+ 18us) server_negotiation.cc:407] Connection header received
0807 20:00:07.205242 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:07.205245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:07.205324 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:07.205405 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:07.206714 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:07.207444 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:07.208915 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:07.209325 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:07.209414 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:07.213676 (+ 4262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:07.213689 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:07.213705 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:07.213738 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:07.216214 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:07.216793 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:07.216798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:07.216800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:07.216930 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:07.217204 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:07.217206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:07.217208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:07.217546 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:07.217765 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:07.218069 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 20:00:07.218240 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 20:00:07.219180 1189 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:07.307694 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 1010
I20260807 20:00:07.330019 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 526
I20260807 20:00:07.331120 615 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:07.442237 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 526
2026-08-07T20:00:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4535 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T20:00:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:07Z Disabled control of system clock
I20260807 20:00:07.537153 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34887
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:34887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:00:07.868815 1267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:07.869107 1267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:07.869237 1267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:07.876425 1267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:07.876528 1267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:07.876590 1267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:07.876665 1267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:07.876724 1267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:07.885700 1267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:34887
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:34887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:07.887012 1267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:07.888931 1267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:07.901034 1272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:07.901095 1273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:07.901057 1276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:07.901889 1267 server_base.cc:1034] running on GCE node
I20260807 20:00:07.902683 1267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:07.904117 1267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:07.905332 1267 hybrid_clock.cc:648] HybridClock initialized: now 1786132807905271 us; error 47 us; skew 500 ppm
I20260807 20:00:07.905642 1267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:07.907817 1267 webserver.cc:460] Webserver started at http://127.5.197.190:43203/ using document root <none> and password file <none>
I20260807 20:00:07.908457 1267 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:07.908542 1267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:07.908809 1267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:07.911530 1267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "918ba6248ad94ea0a28c325bbcb36d71"
format_stamp: "Formatted at 2026-08-07 20:00:07 on dist-test-slave-6bbx"
server_key: "ed5ddcd717c15931a43f4693514fa789"
server_key_iv: "c6c2d28792e1683013e3b5e48d699752"
server_key_version: "encryptionkey@0"
I20260807 20:00:07.912309 1267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "918ba6248ad94ea0a28c325bbcb36d71"
format_stamp: "Formatted at 2026-08-07 20:00:07 on dist-test-slave-6bbx"
server_key: "ed5ddcd717c15931a43f4693514fa789"
server_key_iv: "c6c2d28792e1683013e3b5e48d699752"
server_key_version: "encryptionkey@0"
I20260807 20:00:07.917260 1267 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260807 20:00:07.920535 1283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:07.921836 1267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:07.922003 1267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "918ba6248ad94ea0a28c325bbcb36d71"
format_stamp: "Formatted at 2026-08-07 20:00:07 on dist-test-slave-6bbx"
server_key: "ed5ddcd717c15931a43f4693514fa789"
server_key_iv: "c6c2d28792e1683013e3b5e48d699752"
server_key_version: "encryptionkey@0"
I20260807 20:00:07.922283 1267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:07.939695 1267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:07.940492 1267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:07.940748 1267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:07.958074 1267 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:34887
I20260807 20:00:07.958112 1348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:34887 every 8 connection(s)
I20260807 20:00:07.959378 1267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:07.963135 1350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:07.964126 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 1267
I20260807 20:00:07.964280 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:07.964722 5910 external_mini_cluster.cc:1428] Setting key c777f6fd3deb731b8e156cb97b658da3
I20260807 20:00:07.977522 1350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71: Bootstrap starting.
I20260807 20:00:07.979725 1353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:07.966603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43998 (local address 127.5.197.190:34887)
0807 20:00:07.967743 (+ 1140us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:07.967758 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:07.967825 (+ 67us) server_negotiation.cc:407] Connection header received
0807 20:00:07.969654 (+ 1829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:07.969685 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:07.970293 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:07.970741 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:07.971276 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:07.973160 (+ 1884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:07.974545 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:07.975600 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:07.975821 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:07.976915 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:07.976925 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:07.976943 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:07.977652 (+ 709us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:07.977725 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:07.977751 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:07.977882 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:07.978070 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 20:00:07.978391 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":344,"threads_started":1}
I20260807 20:00:07.981317 1350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:07.982410 1350 log.cc:824] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:07.985175 1350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71: No bootstrap required, opened a new log
I20260807 20:00:07.992697 1350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "918ba6248ad94ea0a28c325bbcb36d71" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34887 } }
I20260807 20:00:07.993052 1350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:07.993149 1350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 918ba6248ad94ea0a28c325bbcb36d71, State: Initialized, Role: FOLLOWER
I20260807 20:00:07.993732 1350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "918ba6248ad94ea0a28c325bbcb36d71" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34887 } }
I20260807 20:00:07.993956 1350 raft_consensus.cc:388] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:07.994087 1350 raft_consensus.cc:482] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:07.994244 1350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:07.996482 1350 raft_consensus.cc:504] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "918ba6248ad94ea0a28c325bbcb36d71" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34887 } }
I20260807 20:00:07.996964 1350 leader_election.cc:302] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 918ba6248ad94ea0a28c325bbcb36d71; no voters:
I20260807 20:00:07.997555 1350 leader_election.cc:288] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:07.997681 1355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:07.998366 1355 raft_consensus.cc:686] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [term 1 LEADER]: Becoming Leader. State: Replica: 918ba6248ad94ea0a28c325bbcb36d71, State: Running, Role: LEADER
I20260807 20:00:07.998886 1355 consensus_queue.cc:237] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "918ba6248ad94ea0a28c325bbcb36d71" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34887 } }
I20260807 20:00:07.999473 1350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:08.001526 1357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "918ba6248ad94ea0a28c325bbcb36d71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "918ba6248ad94ea0a28c325bbcb36d71" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34887 } } }
I20260807 20:00:08.001520 1358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 918ba6248ad94ea0a28c325bbcb36d71. Latest consensus state: current_term: 1 leader_uuid: "918ba6248ad94ea0a28c325bbcb36d71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "918ba6248ad94ea0a28c325bbcb36d71" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 34887 } } }
I20260807 20:00:08.001992 1357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:08.002108 1358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:08.004958 1361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:08.009404 1361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:08.017347 1361 catalog_manager.cc:1347] Generated new cluster ID: 339fe0b5ecdf429599c46f7df6b7229e
I20260807 20:00:08.017458 1361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:08.027233 1361 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:08.028932 1361 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:08.038666 1361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71: Generated new TSK 0
I20260807 20:00:08.039582 1361 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:08.053545 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34887
--builtin_ntp_servers=127.5.197.148:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:00:08.416620 1379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:08.416906 1379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:08.417002 1379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:08.424188 1379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:08.424288 1379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:08.424393 1379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 20:00:08.433884 1379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:08.435101 1379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:08.437032 1379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:08.449996 1389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:08.450033 1390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:08.449947 1392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:08.450872 1379 server_base.cc:1034] running on GCE node
I20260807 20:00:08.451450 1379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:08.452411 1379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:08.453599 1379 hybrid_clock.cc:648] HybridClock initialized: now 1786132808453543 us; error 54 us; skew 500 ppm
I20260807 20:00:08.453899 1379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:08.456286 1379 webserver.cc:460] Webserver started at http://127.5.197.129:39499/ using document root <none> and password file <none>
I20260807 20:00:08.456946 1379 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:08.457046 1379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:08.457369 1379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:08.460356 1379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "9ea05a8dce7642c2affffe64d351f966"
format_stamp: "Formatted at 2026-08-07 20:00:08 on dist-test-slave-6bbx"
server_key: "3da0c522ac0878760dea769bd8a232ca"
server_key_iv: "0bb37bf1278ace906e46eb0adda1f0f6"
server_key_version: "encryptionkey@0"
I20260807 20:00:08.461112 1379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "9ea05a8dce7642c2affffe64d351f966"
format_stamp: "Formatted at 2026-08-07 20:00:08 on dist-test-slave-6bbx"
server_key: "3da0c522ac0878760dea769bd8a232ca"
server_key_iv: "0bb37bf1278ace906e46eb0adda1f0f6"
server_key_version: "encryptionkey@0"
I20260807 20:00:08.466338 1379 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 20:00:08.469825 1401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:08.471263 1379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:08.471405 1379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "9ea05a8dce7642c2affffe64d351f966"
format_stamp: "Formatted at 2026-08-07 20:00:08 on dist-test-slave-6bbx"
server_key: "3da0c522ac0878760dea769bd8a232ca"
server_key_iv: "0bb37bf1278ace906e46eb0adda1f0f6"
server_key_version: "encryptionkey@0"
I20260807 20:00:08.471583 1379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:08.493024 1379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:08.493791 1379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:08.494061 1379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:08.494987 1379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:08.496464 1379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:08.496552 1379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:08.496634 1379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:08.496687 1379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:08.527894 1379 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:38437
I20260807 20:00:08.527971 1546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:38437 every 8 connection(s)
I20260807 20:00:08.529208 1379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 20:00:08.531879 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 1379
I20260807 20:00:08.532073 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 20:00:08.532637 5910 external_mini_cluster.cc:1428] Setting key 178aef088622525c27c05cb1f28818e0
I20260807 20:00:08.535727 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34887
--builtin_ntp_servers=127.5.197.148:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:00:08.542582 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:08.531931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:42705 (local address 127.5.197.190:34887)
0807 20:00:08.532406 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:08.532411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:08.533900 (+ 1489us) server_negotiation.cc:407] Connection header received
0807 20:00:08.536023 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:08.536028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:08.536105 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:08.536212 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:08.537217 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.538286 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.539844 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.540350 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.540467 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:08.541798 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:08.541804 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:08.541808 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:08.541829 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:08.541879 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:08.541893 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:08.541980 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:08.542163 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 20:00:08.542256 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":240,"threads_started":1}
I20260807 20:00:08.543431 1551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:08.532681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34887 (local address 127.5.197.129:42705)
0807 20:00:08.533730 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:08.533781 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:08.535748 (+ 1967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:08.536392 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:08.536399 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:08.536480 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:08.537048 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:08.537064 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.538422 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.538426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:08.539656 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:08.539705 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.540528 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.540533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:08.540781 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:08.541482 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:08.541484 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:08.541524 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:08.541603 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:08.541978 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:08.541984 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:08.541990 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 20:00:08.542120 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 20:00:08.542417 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":313,"threads_started":1}
I20260807 20:00:08.544888 1547 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34887
I20260807 20:00:08.545205 1547 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:08.546063 1547 heartbeater.cc:511] Master 127.5.197.190:34887 requested a full tablet report, sending...
I20260807 20:00:08.548182 1305 ts_manager.cc:194] Registered new tserver with Master: 9ea05a8dce7642c2affffe64d351f966 (127.5.197.129:38437)
I20260807 20:00:08.549576 1305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.129:42705
W20260807 20:00:08.875321 1552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:08.875577 1552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:08.875710 1552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:08.882800 1552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:08.882896 1552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:08.883008 1552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 20:00:08.891932 1552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:08.893234 1552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:08.894980 1552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:08.907843 1560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:08.907863 1558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:08.907919 1563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:08.908558 1552 server_base.cc:1034] running on GCE node
I20260807 20:00:08.909134 1552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:08.910019 1552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:08.911270 1552 hybrid_clock.cc:648] HybridClock initialized: now 1786132808911229 us; error 27 us; skew 500 ppm
I20260807 20:00:08.911549 1552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:08.913733 1552 webserver.cc:460] Webserver started at http://127.5.197.130:39623/ using document root <none> and password file <none>
I20260807 20:00:08.914381 1552 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:08.914466 1552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:08.914738 1552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:08.917603 1552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "52782d72579843e698e2cc93bb6fb0ff"
format_stamp: "Formatted at 2026-08-07 20:00:08 on dist-test-slave-6bbx"
server_key: "1b67c30f55262bd435e7e4d464ce42ea"
server_key_iv: "f7b029b80b5d84b91ff977ca53764041"
server_key_version: "encryptionkey@0"
I20260807 20:00:08.918344 1552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "52782d72579843e698e2cc93bb6fb0ff"
format_stamp: "Formatted at 2026-08-07 20:00:08 on dist-test-slave-6bbx"
server_key: "1b67c30f55262bd435e7e4d464ce42ea"
server_key_iv: "f7b029b80b5d84b91ff977ca53764041"
server_key_version: "encryptionkey@0"
I20260807 20:00:08.923146 1552 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260807 20:00:08.926635 1572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:08.928100 1552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 20:00:08.928263 1552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "52782d72579843e698e2cc93bb6fb0ff"
format_stamp: "Formatted at 2026-08-07 20:00:08 on dist-test-slave-6bbx"
server_key: "1b67c30f55262bd435e7e4d464ce42ea"
server_key_iv: "f7b029b80b5d84b91ff977ca53764041"
server_key_version: "encryptionkey@0"
I20260807 20:00:08.928468 1552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:08.943989 1552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:08.944784 1552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:08.945070 1552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:08.945932 1552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:08.947302 1552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:08.947386 1552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:08.947466 1552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:08.947520 1552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:08.979279 1552 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:39273
I20260807 20:00:08.979321 1723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:39273 every 8 connection(s)
I20260807 20:00:08.980569 1552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 20:00:08.988844 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 1552
I20260807 20:00:08.989022 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 20:00:08.989562 5910 external_mini_cluster.cc:1428] Setting key 314de9257f0c01fe1fcdcefe4ee468c0
I20260807 20:00:08.992709 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34887
--builtin_ntp_servers=127.5.197.148:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:00:08.993211 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:08.983022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:44495 (local address 127.5.197.190:34887)
0807 20:00:08.983205 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:08.983210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:08.984587 (+ 1377us) server_negotiation.cc:407] Connection header received
0807 20:00:08.986258 (+ 1671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:08.986261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:08.986336 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:08.986420 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:08.987373 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.988105 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.990224 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.990760 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.990856 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:08.992331 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:08.992337 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:08.992342 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:08.992362 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:08.992401 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:08.992417 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:08.992507 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:08.992849 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 20:00:08.992942 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 20:00:08.994172 1727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:08.983516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34887 (local address 127.5.197.130:44495)
0807 20:00:08.984440 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:08.984486 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:08.986041 (+ 1555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:08.986599 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:08.986607 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:08.986685 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:08.987214 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:08.987259 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.988244 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.988248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:08.990061 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:08.990084 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:08.990986 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:08.990994 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:08.991256 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:08.992020 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:08.992023 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:08.992060 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:08.992130 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:08.992595 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:08.992606 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:08.992613 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 20:00:08.992811 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 20:00:08.993151 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":288,"threads_started":1}
I20260807 20:00:08.995617 1725 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34887
I20260807 20:00:08.995935 1725 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:08.996663 1725 heartbeater.cc:511] Master 127.5.197.190:34887 requested a full tablet report, sending...
I20260807 20:00:08.998088 1305 ts_manager.cc:194] Registered new tserver with Master: 52782d72579843e698e2cc93bb6fb0ff (127.5.197.130:39273)
I20260807 20:00:08.998926 1305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.130:44495
W20260807 20:00:09.343233 1729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:09.343497 1729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:09.343621 1729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:09.350710 1729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:09.350808 1729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:09.350950 1729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 20:00:09.359735 1729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:34887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:09.360948 1729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:09.362812 1729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:09.375368 1736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:09.375406 1738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:09.375428 1740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:09.376236 1729 server_base.cc:1034] running on GCE node
I20260807 20:00:09.376853 1729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:09.377763 1729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:09.378963 1729 hybrid_clock.cc:648] HybridClock initialized: now 1786132809378910 us; error 45 us; skew 500 ppm
I20260807 20:00:09.379277 1729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:09.381494 1729 webserver.cc:460] Webserver started at http://127.5.197.131:37197/ using document root <none> and password file <none>
I20260807 20:00:09.382185 1729 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:09.382292 1729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:09.382606 1729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:09.385435 1729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "9e47938eaecd41b9a84dfdb071b85006"
format_stamp: "Formatted at 2026-08-07 20:00:09 on dist-test-slave-6bbx"
server_key: "c179f0cc85eeb06f15690955f9508f5a"
server_key_iv: "ca7f87afe77dea3a3e7689dd2260b86e"
server_key_version: "encryptionkey@0"
I20260807 20:00:09.386216 1729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "9e47938eaecd41b9a84dfdb071b85006"
format_stamp: "Formatted at 2026-08-07 20:00:09 on dist-test-slave-6bbx"
server_key: "c179f0cc85eeb06f15690955f9508f5a"
server_key_iv: "ca7f87afe77dea3a3e7689dd2260b86e"
server_key_version: "encryptionkey@0"
I20260807 20:00:09.391289 1729 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 20:00:09.394775 1747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:09.396091 1729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 20:00:09.396286 1729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "9e47938eaecd41b9a84dfdb071b85006"
format_stamp: "Formatted at 2026-08-07 20:00:09 on dist-test-slave-6bbx"
server_key: "c179f0cc85eeb06f15690955f9508f5a"
server_key_iv: "ca7f87afe77dea3a3e7689dd2260b86e"
server_key_version: "encryptionkey@0"
I20260807 20:00:09.396492 1729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:09.412566 1729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:09.413334 1729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:09.413609 1729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:09.414536 1729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:09.415978 1729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:09.416077 1729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:09.416191 1729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:09.416263 1729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:09.446396 1729 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:40901
I20260807 20:00:09.446453 1899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:40901 every 8 connection(s)
I20260807 20:00:09.447918 1729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 20:00:09.454789 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 1729
I20260807 20:00:09.454988 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 20:00:09.455538 5910 external_mini_cluster.cc:1428] Setting key eb53dae6afc49a453f43237fd37aa570
I20260807 20:00:09.460903 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.450371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:34677 (local address 127.5.197.190:34887)
0807 20:00:09.450554 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.450559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.452050 (+ 1491us) server_negotiation.cc:407] Connection header received
0807 20:00:09.453909 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.453914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.453996 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.454087 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:09.455420 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.456396 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.458365 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.458776 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.458874 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.460284 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:09.460289 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:09.460292 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:09.460310 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:09.460342 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:09.460353 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:09.460424 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.460585 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.460670 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 20:00:09.461781 1902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.450934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:34887 (local address 127.5.197.131:34677)
0807 20:00:09.451895 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:09.451939 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:09.453637 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:09.454329 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:09.454337 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:09.454436 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:09.455228 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.455256 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.456577 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.456583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.458224 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.458236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.458989 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.458994 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.459242 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.459958 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:09.459962 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:09.460012 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:09.460101 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:09.460432 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:09.460438 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:09.460443 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:00:09.460571 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 20:00:09.460846 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":274,"threads_started":1}
I20260807 20:00:09.463004 1900 heartbeater.cc:347] Connected to a master server at 127.5.197.190:34887
I20260807 20:00:09.463238 1900 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:09.463955 1900 heartbeater.cc:511] Master 127.5.197.190:34887 requested a full tablet report, sending...
I20260807 20:00:09.465271 1305 ts_manager.cc:194] Registered new tserver with Master: 9e47938eaecd41b9a84dfdb071b85006 (127.5.197.131:40901)
I20260807 20:00:09.466022 1305 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.131:34677
I20260807 20:00:09.470520 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:00:09.480185 1550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.474555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44008 (local address 127.5.197.190:34887)
0807 20:00:09.474736 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.474740 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.475252 (+ 512us) server_negotiation.cc:407] Connection header received
0807 20:00:09.475382 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.475386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.475456 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.475552 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:09.476043 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.476731 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.478025 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.478419 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.478510 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.479507 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:09.479511 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:09.479514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:09.479531 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:09.479557 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:09.479567 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:09.479659 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.479854 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.479906 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 20:00:09.483736 1305 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:00:09.490355 1305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:00:09.512290 1915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.502865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:40901 (local address 127.0.0.1:35004)
0807 20:00:09.503974 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:09.503991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:09.504175 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:09.505591 (+ 1416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:09.505596 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:09.505664 (+ 68us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:09.506017 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.506031 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.507811 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.507816 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.509459 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.509477 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.511290 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.511297 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.511505 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.511559 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 20:00:09.511719 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 20:00:09.511908 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"mutex_wait_us":2,"thread_start_us":634,"threads_started":1}
I20260807 20:00:09.512310 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.503504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35004 (local address 127.5.197.131:40901)
0807 20:00:09.504691 (+ 1187us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.504700 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.504735 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:00:09.504850 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.504857 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.505089 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.505286 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:09.506208 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.507636 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.509682 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.511098 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.511234 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.511487 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.511811 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.511976 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":994,"thread_start_us":840,"threads_started":1}
I20260807 20:00:09.512729 1917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.502382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46688)
0807 20:00:09.503561 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:09.503616 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:09.504419 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:09.505165 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:09.505173 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:09.505200 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:09.505537 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.505549 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.507404 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.507410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.509558 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.509570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.511619 (+ 2049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.511624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.511803 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.511836 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:00:09.511917 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 20:00:09.512030 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"mutex_wait_us":24,"thread_start_us":810,"threads_started":1}
I20260807 20:00:09.513293 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.504022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:39273 (local address 127.0.0.1:44252)
0807 20:00:09.504865 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:09.504883 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:09.504989 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:09.506566 (+ 1577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:09.506571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:09.506596 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:09.507026 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.507038 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.509090 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.509095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.510923 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.510937 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.512707 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.512713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.512855 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.512878 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 20:00:09.512928 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:00:09.513031 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"spinlock_wait_cycles":2304,"thread_start_us":724,"threads_started":1}
I20260807 20:00:09.513942 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.502442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46688 (local address 127.5.197.129:38437)
0807 20:00:09.503021 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.503030 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.503745 (+ 715us) server_negotiation.cc:407] Connection header received
0807 20:00:09.504607 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.504617 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.504869 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.505031 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:09.505701 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.507241 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.509783 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.511106 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.511208 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.511456 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.513433 (+ 1977us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.513606 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":307,"threads_started":1}
I20260807 20:00:09.514225 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.504570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44252 (local address 127.5.197.130:39273)
0807 20:00:09.506040 (+ 1470us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.506048 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.506077 (+ 29us) server_negotiation.cc:407] Connection header received
0807 20:00:09.506171 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.506178 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.506370 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.507218 (+ 848us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:09.507431 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.508938 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.511131 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.512502 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.513582 (+ 1080us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.513741 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.513800 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.513918 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1319,"thread_start_us":1231,"threads_started":1}
I20260807 20:00:09.516521 1813 tablet_service.cc:1467] Processing CreateTablet for tablet 76ded960dbbd4b3da2ef523782101304 (DEFAULT_TABLE table=test-table [id=ab035425737f4271bd4da1cb0eda427c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:09.517098 1638 tablet_service.cc:1467] Processing CreateTablet for tablet 76ded960dbbd4b3da2ef523782101304 (DEFAULT_TABLE table=test-table [id=ab035425737f4271bd4da1cb0eda427c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:09.517409 1463 tablet_service.cc:1467] Processing CreateTablet for tablet 76ded960dbbd4b3da2ef523782101304 (DEFAULT_TABLE table=test-table [id=ab035425737f4271bd4da1cb0eda427c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:09.518114 1813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76ded960dbbd4b3da2ef523782101304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:09.518282 1638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76ded960dbbd4b3da2ef523782101304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:09.518692 1463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76ded960dbbd4b3da2ef523782101304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:09.529618 1924 tablet_bootstrap.cc:492] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Bootstrap starting.
I20260807 20:00:09.534816 1924 tablet_bootstrap.cc:654] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:09.536227 1924 log.cc:824] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:09.538864 1925 tablet_bootstrap.cc:492] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: Bootstrap starting.
I20260807 20:00:09.539295 1926 tablet_bootstrap.cc:492] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Bootstrap starting.
I20260807 20:00:09.541098 1924 tablet_bootstrap.cc:492] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: No bootstrap required, opened a new log
I20260807 20:00:09.541464 1924 ts_tablet_manager.cc:1397] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260807 20:00:09.543139 1926 tablet_bootstrap.cc:654] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:09.543387 1925 tablet_bootstrap.cc:654] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:09.544164 1926 log.cc:824] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:09.544567 1925 log.cc:824] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:09.547015 1925 tablet_bootstrap.cc:492] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: No bootstrap required, opened a new log
I20260807 20:00:09.547092 1926 tablet_bootstrap.cc:492] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: No bootstrap required, opened a new log
I20260807 20:00:09.547322 1925 ts_tablet_manager.cc:1397] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 20:00:09.547403 1926 ts_tablet_manager.cc:1397] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 20:00:09.551582 1924 raft_consensus.cc:348] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.552102 1924 raft_consensus.cc:374] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:09.552237 1924 raft_consensus.cc:729] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52782d72579843e698e2cc93bb6fb0ff, State: Initialized, Role: FOLLOWER
I20260807 20:00:09.552477 1547 heartbeater.cc:503] Master 127.5.197.190:34887 was elected leader, sending a full tablet report...
I20260807 20:00:09.553033 1924 consensus_queue.cc:260] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.554847 1924 ts_tablet_manager.cc:1428] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260807 20:00:09.556066 1725 heartbeater.cc:503] Master 127.5.197.190:34887 was elected leader, sending a full tablet report...
I20260807 20:00:09.556396 1925 raft_consensus.cc:348] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.556856 1925 raft_consensus.cc:374] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:09.556993 1925 raft_consensus.cc:729] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea05a8dce7642c2affffe64d351f966, State: Initialized, Role: FOLLOWER
I20260807 20:00:09.557655 1925 consensus_queue.cc:260] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.560446 1926 raft_consensus.cc:348] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.560983 1926 raft_consensus.cc:374] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:09.561141 1926 raft_consensus.cc:729] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e47938eaecd41b9a84dfdb071b85006, State: Initialized, Role: FOLLOWER
I20260807 20:00:09.561793 1926 consensus_queue.cc:260] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.563786 1925 ts_tablet_manager.cc:1428] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: Time spent starting tablet: real 0.016s user 0.018s sys 0.000s
I20260807 20:00:09.564555 1900 heartbeater.cc:503] Master 127.5.197.190:34887 was elected leader, sending a full tablet report...
I20260807 20:00:09.565605 1926 ts_tablet_manager.cc:1428] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Time spent starting tablet: real 0.018s user 0.012s sys 0.002s
W20260807 20:00:09.699564 1901 tablet.cc:2369] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:00:09.732677 1726 tablet.cc:2369] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:09.750473 1934 raft_consensus.cc:482] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:00:09.750784 1934 raft_consensus.cc:504] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.752475 1934 leader_election.cc:288] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52782d72579843e698e2cc93bb6fb0ff (127.5.197.130:39273), 9e47938eaecd41b9a84dfdb071b85006 (127.5.197.131:40901)
I20260807 20:00:09.759413 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.752945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:57529 (local address 127.5.197.131:40901)
0807 20:00:09.753152 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.753159 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.753869 (+ 710us) server_negotiation.cc:407] Connection header received
0807 20:00:09.754018 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.754024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.754107 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.754179 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:09.754849 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.755616 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.757752 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.758502 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.758663 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.758734 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.759031 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.759157 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 20:00:09.759450 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.752971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:49215 (local address 127.5.197.130:39273)
0807 20:00:09.753170 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.753177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.753966 (+ 789us) server_negotiation.cc:407] Connection header received
0807 20:00:09.754113 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.754117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.754202 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.754295 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:09.754931 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.755604 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.757754 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.758508 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.758646 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.758728 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.759098 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.759220 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 20:00:09.759549 1938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.753014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:39273 (local address 127.5.197.129:49215)
0807 20:00:09.753828 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:09.753845 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:09.753987 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:09.754333 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:09.754336 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:09.754360 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:09.754748 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.754760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.755747 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.755752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.757515 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.757528 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.758743 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.758752 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.758919 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.758941 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 20:00:09.759028 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 20:00:09.759171 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":190,"thread_start_us":409,"threads_started":1}
I20260807 20:00:09.759572 1937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.752885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:40901 (local address 127.5.197.129:57529)
0807 20:00:09.753745 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:09.753766 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:09.753892 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:09.754263 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:09.754268 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:09.754296 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:09.754683 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.754696 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.755767 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.755772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.757519 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:09.757532 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.758702 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.758709 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:09.758868 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.758907 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 20:00:09.758975 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 20:00:09.759105 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":100,"thread_start_us":500,"threads_started":1}
I20260807 20:00:09.760670 1666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76ded960dbbd4b3da2ef523782101304" candidate_uuid: "9ea05a8dce7642c2affffe64d351f966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52782d72579843e698e2cc93bb6fb0ff" is_pre_election: true
I20260807 20:00:09.760702 1839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76ded960dbbd4b3da2ef523782101304" candidate_uuid: "9ea05a8dce7642c2affffe64d351f966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e47938eaecd41b9a84dfdb071b85006" is_pre_election: true
I20260807 20:00:09.761168 1839 raft_consensus.cc:2454] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ea05a8dce7642c2affffe64d351f966 in term 0.
I20260807 20:00:09.761164 1666 raft_consensus.cc:2454] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ea05a8dce7642c2affffe64d351f966 in term 0.
I20260807 20:00:09.761762 1404 leader_election.cc:302] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52782d72579843e698e2cc93bb6fb0ff, 9ea05a8dce7642c2affffe64d351f966; no voters:
I20260807 20:00:09.762123 1934 raft_consensus.cc:2781] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:00:09.762295 1934 raft_consensus.cc:482] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:00:09.762398 1934 raft_consensus.cc:3037] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:09.764598 1934 raft_consensus.cc:504] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.765280 1934 leader_election.cc:288] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [CANDIDATE]: Term 1 election: Requested vote from peers 52782d72579843e698e2cc93bb6fb0ff (127.5.197.130:39273), 9e47938eaecd41b9a84dfdb071b85006 (127.5.197.131:40901)
I20260807 20:00:09.765678 1666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76ded960dbbd4b3da2ef523782101304" candidate_uuid: "9ea05a8dce7642c2affffe64d351f966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52782d72579843e698e2cc93bb6fb0ff"
I20260807 20:00:09.765872 1666 raft_consensus.cc:3037] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:09.765939 1839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76ded960dbbd4b3da2ef523782101304" candidate_uuid: "9ea05a8dce7642c2affffe64d351f966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e47938eaecd41b9a84dfdb071b85006"
I20260807 20:00:09.766139 1839 raft_consensus.cc:3037] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:09.768139 1666 raft_consensus.cc:2454] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ea05a8dce7642c2affffe64d351f966 in term 1.
I20260807 20:00:09.768384 1839 raft_consensus.cc:2454] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ea05a8dce7642c2affffe64d351f966 in term 1.
I20260807 20:00:09.768489 1404 leader_election.cc:302] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52782d72579843e698e2cc93bb6fb0ff, 9ea05a8dce7642c2affffe64d351f966; no voters:
I20260807 20:00:09.768771 1934 raft_consensus.cc:2781] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:09.769196 1934 raft_consensus.cc:686] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 1 LEADER]: Becoming Leader. State: Replica: 9ea05a8dce7642c2affffe64d351f966, State: Running, Role: LEADER
I20260807 20:00:09.769665 1934 consensus_queue.cc:237] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } }
I20260807 20:00:09.774564 1304 catalog_manager.cc:5495] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ea05a8dce7642c2affffe64d351f966 (127.5.197.129). New cstate: current_term: 1 leader_uuid: "9ea05a8dce7642c2affffe64d351f966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea05a8dce7642c2affffe64d351f966" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 38437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 } health_report { overall_health: UNKNOWN } } }
W20260807 20:00:09.781497 1548 tablet.cc:2369] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:09.809870 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.804419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46702 (local address 127.5.197.129:38437)
0807 20:00:09.804614 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.804621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.804717 (+ 96us) server_negotiation.cc:407] Connection header received
0807 20:00:09.804942 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.804946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.805042 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.805174 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:00:09.805588 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.806288 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.807694 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.808122 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.808246 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.808810 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:00:09.809293 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:00:09.809453 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.809601 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.809643 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 20:00:09.817687 1666 raft_consensus.cc:1261] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 1 FOLLOWER]: Refusing update from remote peer 9ea05a8dce7642c2affffe64d351f966: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:09.817684 1839 raft_consensus.cc:1261] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 1 FOLLOWER]: Refusing update from remote peer 9ea05a8dce7642c2affffe64d351f966: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:09.818552 1939 consensus_queue.cc:1035] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e47938eaecd41b9a84dfdb071b85006" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:09.818893 1934 consensus_queue.cc:1035] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52782d72579843e698e2cc93bb6fb0ff" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:09.841734 1305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:09.841974 1305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:09.845233 1305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 918ba6248ad94ea0a28c325bbcb36d71: Sending DeleteTablet for 3 replicas of tablet 76ded960dbbd4b3da2ef523782101304
I20260807 20:00:09.846344 1463 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ded960dbbd4b3da2ef523782101304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:09 UTC) from {username='slave'} at 127.0.0.1:46688
I20260807 20:00:09.846410 1638 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ded960dbbd4b3da2ef523782101304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:09 UTC) from {username='slave'} at 127.0.0.1:44252
I20260807 20:00:09.846948 1813 tablet_service.cc:1514] Processing DeleteTablet for tablet 76ded960dbbd4b3da2ef523782101304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:09 UTC) from {username='slave'} at 127.0.0.1:35004
I20260807 20:00:09.848587 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 1379
I20260807 20:00:09.857664 1959 tablet_replica.cc:330] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: stopping tablet replica
I20260807 20:00:09.858271 1959 raft_consensus.cc:2229] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:09.858888 1959 raft_consensus.cc:2258] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:09.861308 1959 ts_tablet_manager.cc:1905] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:09.868620 1959 ts_tablet_manager.cc:1918] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:09.868868 1959 log.cc:1196] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/76ded960dbbd4b3da2ef523782101304
I20260807 20:00:09.869558 1959 ts_tablet_manager.cc:1939] T 76ded960dbbd4b3da2ef523782101304 P 52782d72579843e698e2cc93bb6fb0ff: Deleting consensus metadata
I20260807 20:00:09.871605 1285 catalog_manager.cc:4841] TS 52782d72579843e698e2cc93bb6fb0ff (127.5.197.130:39273): tablet 76ded960dbbd4b3da2ef523782101304 (table test-table [id=ab035425737f4271bd4da1cb0eda427c]) successfully deleted
I20260807 20:00:09.874579 1960 tablet_replica.cc:330] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: stopping tablet replica
I20260807 20:00:09.875114 1960 raft_consensus.cc:2229] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:09.875819 1960 raft_consensus.cc:2258] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:09.878129 1960 ts_tablet_manager.cc:1905] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:09.878705 1958 tablet_replica.cc:330] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: stopping tablet replica
I20260807 20:00:09.879130 1958 raft_consensus.cc:2229] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:00:09.879871 1958 raft_consensus.cc:2258] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:09.881752 1958 ts_tablet_manager.cc:1905] T 76ded960dbbd4b3da2ef523782101304 P 9ea05a8dce7642c2affffe64d351f966: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:09.883280 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:09.849894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46710 (local address 127.5.197.129:38437)
0807 20:00:09.850099 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:09.850106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:09.874604 (+ 24498us) server_negotiation.cc:407] Connection header received
0807 20:00:09.875160 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:09.875166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:09.875273 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:09.875371 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:09.876173 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.877377 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.879135 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:09.879781 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:09.879884 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:09.881552 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:09.881563 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:09.881578 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:09.882372 (+ 794us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:09.882428 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:09.882452 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:09.882530 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:09.882774 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 20:00:09.882882 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 20:00:09.884672 1538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:09.886229 1960 ts_tablet_manager.cc:1918] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:09.886482 1960 log.cc:1196] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/76ded960dbbd4b3da2ef523782101304
I20260807 20:00:09.887022 1960 ts_tablet_manager.cc:1939] T 76ded960dbbd4b3da2ef523782101304 P 9e47938eaecd41b9a84dfdb071b85006: Deleting consensus metadata
I20260807 20:00:09.888819 1286 catalog_manager.cc:4841] TS 9e47938eaecd41b9a84dfdb071b85006 (127.5.197.131:40901): tablet 76ded960dbbd4b3da2ef523782101304 (table test-table [id=ab035425737f4271bd4da1cb0eda427c]) successfully deleted
I20260807 20:00:09.984611 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 1379
W20260807 20:00:10.008127 1285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.197.129:38437 (error 108)
I20260807 20:00:10.008363 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 1552
I20260807 20:00:10.009845 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.009410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46714)
0807 20:00:10.009596 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:10.009707 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 20:00:10.010102 1285 catalog_manager.cc:4584] TS 9ea05a8dce7642c2affffe64d351f966 (127.5.197.129:38437): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 76ded960dbbd4b3da2ef523782101304: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
I20260807 20:00:10.014850 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.009151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44262 (local address 127.5.197.130:39273)
0807 20:00:10.009370 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:10.009376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:10.009397 (+ 21us) server_negotiation.cc:407] Connection header received
0807 20:00:10.009460 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:10.009466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:10.009546 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:10.009630 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:10.010103 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:10.010966 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:10.012257 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:10.012654 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:10.012744 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:10.013678 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:10.013686 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:10.013700 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:10.014254 (+ 554us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:10.014300 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:10.014330 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:10.014420 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:10.014523 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 20:00:10.014609 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 20:00:10.015493 1718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:10.063657 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.063199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46730)
0807 20:00:10.063416 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:10.063509 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 20:00:10.064692 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.064335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46736)
0807 20:00:10.064491 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:10.064569 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 20:00:10.103016 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 1552
I20260807 20:00:10.125241 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.124724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46740)
0807 20:00:10.124968 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:10.125061 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 20:00:10.126300 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.125940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46744)
0807 20:00:10.126066 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:10.126151 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 20:00:10.127733 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 1729
I20260807 20:00:10.134398 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.128447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35008 (local address 127.5.197.131:40901)
0807 20:00:10.128632 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:10.128638 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:10.128657 (+ 19us) server_negotiation.cc:407] Connection header received
0807 20:00:10.128820 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:10.128825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:10.128924 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:10.129010 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:10.129444 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:10.130156 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:10.131532 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:10.131977 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:10.132094 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:10.133090 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:10.133100 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:10.133117 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:10.133681 (+ 564us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:10.133735 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:10.133754 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:10.133853 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:10.133998 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 20:00:10.134104 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 20:00:10.135021 1895 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:10.206509 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.206017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46748)
0807 20:00:10.206231 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:10.206330 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 20:00:10.207548 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:10.207156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:38437 (local address 127.0.0.1:46758)
0807 20:00:10.207361 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:10.207435 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260807 20:00:10.221174 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 1729
I20260807 20:00:10.243542 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 1267
I20260807 20:00:10.244654 1342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:10.352747 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 1267
2026-08-07T20:00:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2910 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:10 dist-test-slave-6bbx krb5kdc[1974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:10 dist-test-slave-6bbx krb5kdc[1974](info): set up 2 sockets
Aug 07 20:00:10 dist-test-slave-6bbx krb5kdc[1974](info): commencing operation
krb5kdc: starting...
W20260807 20:00:11.573709 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.002s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:11 dist-test-slave-6bbx krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:11.883953 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:42939
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:42939
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:12.219237 1993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:12.219545 1993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:12.219698 1993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:12.228363 1993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:12.228458 1993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:12.228515 1993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:12.228595 1993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:12.228657 1993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:12.238687 1993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:42939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:42939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:12.240015 1993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:12.241322 1993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:12.252749 1998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:12.252795 1999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:12.252998 2001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:12.253763 1993 server_base.cc:1034] running on GCE node
I20260807 20:00:12.254508 1993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:12.255941 1993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:12.257153 1993 hybrid_clock.cc:648] HybridClock initialized: now 1786132812257104 us; error 34 us; skew 500 ppm
I20260807 20:00:12.257486 1993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:12 dist-test-slave-6bbx krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:12.264909 1993 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:12.266347 1993 webserver.cc:460] Webserver started at http://127.5.197.190:46045/ using document root <none> and password file <none>
I20260807 20:00:12.267019 1993 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:12.267138 1993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:12.267431 1993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:12.270421 1993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "31a6546152474890a17a36c88cccf8d2"
format_stamp: "Formatted at 2026-08-07 20:00:12 on dist-test-slave-6bbx"
server_key: "2dff73bda148c3a26cd01a64e4b30c22"
server_key_iv: "eb6a31fcf1af59b9d3607c73bacb692d"
server_key_version: "encryptionkey@0"
I20260807 20:00:12.271164 1993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "31a6546152474890a17a36c88cccf8d2"
format_stamp: "Formatted at 2026-08-07 20:00:12 on dist-test-slave-6bbx"
server_key: "2dff73bda148c3a26cd01a64e4b30c22"
server_key_iv: "eb6a31fcf1af59b9d3607c73bacb692d"
server_key_version: "encryptionkey@0"
I20260807 20:00:12.276192 1993 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 20:00:12.279456 2010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:12.280750 1993 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 20:00:12.280938 1993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "31a6546152474890a17a36c88cccf8d2"
format_stamp: "Formatted at 2026-08-07 20:00:12 on dist-test-slave-6bbx"
server_key: "2dff73bda148c3a26cd01a64e4b30c22"
server_key_iv: "eb6a31fcf1af59b9d3607c73bacb692d"
server_key_version: "encryptionkey@0"
I20260807 20:00:12.281116 1993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:12.297397 1993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:12.301486 1993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:12.301748 1993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:12.318436 1993 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:42939
I20260807 20:00:12.318455 2081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:42939 every 8 connection(s)
I20260807 20:00:12.319758 1993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:12.323378 2082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:12.323942 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 1993
I20260807 20:00:12.324108 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:12.324565 5910 external_mini_cluster.cc:1428] Setting key 07d559978b62e98846fa304ece992608
I20260807 20:00:12.337177 2082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2: Bootstrap starting.
Aug 07 20:00:12 dist-test-slave-6bbx krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:12.340507 2082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:12.341581 2082 log.cc:824] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:12.344633 2082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2: No bootstrap required, opened a new log
I20260807 20:00:12.348053 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:12.326332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39536 (local address 127.5.197.190:42939)
0807 20:00:12.327127 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:12.327146 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:12.327195 (+ 49us) server_negotiation.cc:407] Connection header received
0807 20:00:12.329683 (+ 2488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:12.329716 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:12.330196 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:12.330646 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:12.331971 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:12.333931 (+ 1960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:12.335252 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:12.336259 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:12.336439 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:12.340791 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:12.340798 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:12.340815 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:12.340852 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:12.343972 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:12.344796 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:12.344805 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:12.344813 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:12.344974 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:12.345447 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:12.345453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:12.345455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:12.345949 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:12.346162 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:12.346657 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 20:00:12.347005 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":315,"threads_started":1}
I20260807 20:00:12.353071 2082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a6546152474890a17a36c88cccf8d2" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42939 } }
I20260807 20:00:12.353412 2082 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:12.353523 2082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a6546152474890a17a36c88cccf8d2, State: Initialized, Role: FOLLOWER
I20260807 20:00:12.354112 2082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a6546152474890a17a36c88cccf8d2" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42939 } }
I20260807 20:00:12.354328 2082 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:12.354424 2082 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:12.354547 2082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:12.356741 2082 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a6546152474890a17a36c88cccf8d2" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42939 } }
I20260807 20:00:12.357210 2082 leader_election.cc:302] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31a6546152474890a17a36c88cccf8d2; no voters:
I20260807 20:00:12.357751 2082 leader_election.cc:288] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:12.357870 2087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:12.358491 2087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [term 1 LEADER]: Becoming Leader. State: Replica: 31a6546152474890a17a36c88cccf8d2, State: Running, Role: LEADER
I20260807 20:00:12.359054 2087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a6546152474890a17a36c88cccf8d2" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42939 } }
I20260807 20:00:12.359715 2082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:12.361620 2088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31a6546152474890a17a36c88cccf8d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a6546152474890a17a36c88cccf8d2" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42939 } } }
I20260807 20:00:12.361914 2088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:12.362834 2090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31a6546152474890a17a36c88cccf8d2. Latest consensus state: current_term: 1 leader_uuid: "31a6546152474890a17a36c88cccf8d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a6546152474890a17a36c88cccf8d2" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 42939 } } }
I20260807 20:00:12.363301 2090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:12.364240 2093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:12.369104 2093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:12.378206 2093 catalog_manager.cc:1347] Generated new cluster ID: a6ed838a7f9b4eb18e10566d09980339
I20260807 20:00:12.378320 2093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:12.428269 2093 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:12.429603 2093 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:12.442770 2093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2: Generated new TSK 0
I20260807 20:00:12.443588 2093 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.197.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
Entry for principal kudu/127.5.197.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab.
I20260807 20:00:12.532505 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:42939
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:12.875393 2114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:12.875730 2114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:12.875882 2114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:12.883123 2114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:12.883236 2114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:12.883388 2114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 20:00:12.893221 2114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.129.keytab
--principal=kudu/127.5.197.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:42939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:12.894515 2114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:12.895898 2114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:12.909087 2120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:12.909144 2122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:12.909183 2124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:12.909565 2114 server_base.cc:1034] running on GCE node
I20260807 20:00:12.910301 2114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:12.911206 2114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:12.912405 2114 hybrid_clock.cc:648] HybridClock initialized: now 1786132812912351 us; error 40 us; skew 500 ppm
I20260807 20:00:12.912700 2114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:12 dist-test-slave-6bbx krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:12.916039 2114 init.cc:377] Logged in from keytab as kudu/127.5.197.129@KRBTEST.COM (short username kudu)
I20260807 20:00:12.917443 2114 webserver.cc:460] Webserver started at http://127.5.197.129:40419/ using document root <none> and password file <none>
I20260807 20:00:12.918097 2114 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:12.918216 2114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:12.918534 2114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:12.921432 2114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "958994f7578244ce9a9347e9c3b0d3c9"
format_stamp: "Formatted at 2026-08-07 20:00:12 on dist-test-slave-6bbx"
server_key: "e314f405fab16e1e58a14bad774addd5"
server_key_iv: "3086491ed92f887de1ff4da4e21ca2a0"
server_key_version: "encryptionkey@0"
I20260807 20:00:12.922197 2114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "958994f7578244ce9a9347e9c3b0d3c9"
format_stamp: "Formatted at 2026-08-07 20:00:12 on dist-test-slave-6bbx"
server_key: "e314f405fab16e1e58a14bad774addd5"
server_key_iv: "3086491ed92f887de1ff4da4e21ca2a0"
server_key_version: "encryptionkey@0"
I20260807 20:00:12.927076 2114 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260807 20:00:12.930397 2135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:12.931595 2114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 20:00:12.931794 2114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "958994f7578244ce9a9347e9c3b0d3c9"
format_stamp: "Formatted at 2026-08-07 20:00:12 on dist-test-slave-6bbx"
server_key: "e314f405fab16e1e58a14bad774addd5"
server_key_iv: "3086491ed92f887de1ff4da4e21ca2a0"
server_key_version: "encryptionkey@0"
I20260807 20:00:12.931988 2114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:12.966017 2114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:12.969993 2114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:12.970263 2114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:12.971274 2114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:12.972635 2114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:12.972723 2114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:12.972867 2114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:12.972930 2114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:13.004109 2114 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:39349
I20260807 20:00:13.004163 2287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:39349 every 8 connection(s)
I20260807 20:00:13.005398 2114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 20:00:13.015726 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 2114
I20260807 20:00:13.015899 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 20:00:13.016321 5910 external_mini_cluster.cc:1428] Setting key c93ede2fd09b4434728b61875d60f7ff
Aug 07 20:00:13 dist-test-slave-6bbx krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132812, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.129@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:13.025265 2290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:13.007805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:51681 (local address 127.5.197.190:42939)
0807 20:00:13.008232 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:13.008238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:13.009166 (+ 928us) server_negotiation.cc:407] Connection header received
0807 20:00:13.011046 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:13.011053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:13.011133 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:13.011231 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:13.012816 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.013531 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.015056 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.015470 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.015582 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:13.019607 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:13.019617 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:13.019620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:13.019697 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:13.022317 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:13.023113 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:13.023116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:13.023119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:13.023239 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:13.023689 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:13.023694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:13.023696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:13.023959 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:13.024077 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:13.024847 (+ 770us) server_negotiation.cc:299] Negotiation successful
0807 20:00:13.025006 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":209,"threads_started":1}
I20260807 20:00:13.026491 2291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:13.008307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:42939 (local address 127.5.197.129:51681)
0807 20:00:13.008995 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:13.009034 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:13.010762 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:13.011498 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:13.011506 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:13.012062 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:13.012636 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:13.012654 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.013680 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.013685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:13.014908 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:13.014920 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.015734 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.015743 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:13.016008 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:13.016625 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:13.016652 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:13.019356 (+ 2704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:13.022461 (+ 3105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:13.022470 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:13.022484 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:13.023012 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:13.023336 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:13.023340 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:13.023343 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:13.023574 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:13.024084 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:13.024090 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:13.024467 (+ 377us) client_negotiation.cc:769] Sending connection context
0807 20:00:13.024746 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 20:00:13.025227 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":273,"threads_started":1}
I20260807 20:00:13.028038 2288 heartbeater.cc:347] Connected to a master server at 127.5.197.190:42939
I20260807 20:00:13.028328 2288 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:13.029024 2288 heartbeater.cc:511] Master 127.5.197.190:42939 requested a full tablet report, sending...
I20260807 20:00:13.031026 2033 ts_manager.cc:194] Registered new tserver with Master: 958994f7578244ce9a9347e9c3b0d3c9 (127.5.197.129:39349)
I20260807 20:00:13.032501 2033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.129@KRBTEST.COM'} at 127.5.197.129:51681
WARNING: no policy specified for kudu/127.5.197.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
Entry for principal kudu/127.5.197.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab.
I20260807 20:00:13.088280 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:42939
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:13.433409 2294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:13.433670 2294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:13.433818 2294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:13.440979 2294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:13.441082 2294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:13.441242 2294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 20:00:13.450600 2294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.130.keytab
--principal=kudu/127.5.197.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:42939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:13.451923 2294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:13.453248 2294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:13.465976 2305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:13.466059 2304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:13.466035 2307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:13.466900 2294 server_base.cc:1034] running on GCE node
I20260807 20:00:13.467492 2294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:13.468422 2294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:13.469626 2294 hybrid_clock.cc:648] HybridClock initialized: now 1786132813469574 us; error 43 us; skew 500 ppm
I20260807 20:00:13.469934 2294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:13 dist-test-slave-6bbx krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132813, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:13.472947 2294 init.cc:377] Logged in from keytab as kudu/127.5.197.130@KRBTEST.COM (short username kudu)
I20260807 20:00:13.474306 2294 webserver.cc:460] Webserver started at http://127.5.197.130:41839/ using document root <none> and password file <none>
I20260807 20:00:13.474964 2294 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:13.475085 2294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:13.475389 2294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:13.478284 2294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "50c70785ffcc43c0ba06a9f585c19c44"
format_stamp: "Formatted at 2026-08-07 20:00:13 on dist-test-slave-6bbx"
server_key: "ed77013b90cada7e9598650ba87f62c3"
server_key_iv: "a783f1d94fc5817cf675b72a54fea63f"
server_key_version: "encryptionkey@0"
I20260807 20:00:13.479068 2294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "50c70785ffcc43c0ba06a9f585c19c44"
format_stamp: "Formatted at 2026-08-07 20:00:13 on dist-test-slave-6bbx"
server_key: "ed77013b90cada7e9598650ba87f62c3"
server_key_iv: "a783f1d94fc5817cf675b72a54fea63f"
server_key_version: "encryptionkey@0"
I20260807 20:00:13.484236 2294 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260807 20:00:13.487653 2316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:13.488967 2294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:13.489113 2294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "50c70785ffcc43c0ba06a9f585c19c44"
format_stamp: "Formatted at 2026-08-07 20:00:13 on dist-test-slave-6bbx"
server_key: "ed77013b90cada7e9598650ba87f62c3"
server_key_iv: "a783f1d94fc5817cf675b72a54fea63f"
server_key_version: "encryptionkey@0"
I20260807 20:00:13.489296 2294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:13.506210 2294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:13.510103 2294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:13.510370 2294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:13.511282 2294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:13.512603 2294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:13.512682 2294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:13.512816 2294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:13.512871 2294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:13.542835 2294 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:46229
I20260807 20:00:13.542873 2468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:46229 every 8 connection(s)
I20260807 20:00:13.544078 2294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 20:00:13.548734 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 2294
I20260807 20:00:13.548900 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 20:00:13.549340 5910 external_mini_cluster.cc:1428] Setting key c75d2b11bae0f054bfb24f21825548e9
Aug 07 20:00:13 dist-test-slave-6bbx krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132813, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.130@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:13.564944 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:13.546421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:37277 (local address 127.5.197.190:42939)
0807 20:00:13.546835 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:13.546840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:13.547837 (+ 997us) server_negotiation.cc:407] Connection header received
0807 20:00:13.549748 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:13.549753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:13.549847 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:13.549961 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:13.551735 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.552416 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.554514 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.554939 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.555028 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:13.558992 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:13.558997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:13.559000 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:13.559035 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:13.561846 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:13.562635 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:13.562639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:13.562641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:13.562778 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:13.563249 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:13.563254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:13.563256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:13.563542 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:13.563719 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:13.564471 (+ 752us) server_negotiation.cc:299] Negotiation successful
0807 20:00:13.564642 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":192,"threads_started":1}
I20260807 20:00:13.566267 2472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:13.546959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:42939 (local address 127.5.197.130:37277)
0807 20:00:13.547686 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:13.547734 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:13.549483 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:13.550261 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:13.550274 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:13.550789 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:13.551522 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:13.551550 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.552583 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.552588 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:13.554387 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:13.554402 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:13.555151 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:13.555157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:13.555419 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:13.556119 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:13.556151 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:13.558730 (+ 2579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:13.561983 (+ 3253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:13.561991 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:13.562008 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:13.562540 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:13.562873 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:13.562877 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:13.562880 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:13.563108 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:13.563692 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:13.563700 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:13.564100 (+ 400us) client_negotiation.cc:769] Sending connection context
0807 20:00:13.564412 (+ 312us) client_negotiation.cc:240] Negotiation successful
0807 20:00:13.564952 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":299,"threads_started":1}
I20260807 20:00:13.567920 2469 heartbeater.cc:347] Connected to a master server at 127.5.197.190:42939
I20260807 20:00:13.568203 2469 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:13.568920 2469 heartbeater.cc:511] Master 127.5.197.190:42939 requested a full tablet report, sending...
I20260807 20:00:13.570447 2033 ts_manager.cc:194] Registered new tserver with Master: 50c70785ffcc43c0ba06a9f585c19c44 (127.5.197.130:46229)
I20260807 20:00:13.571511 2033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.130@KRBTEST.COM'} at 127.5.197.130:37277
WARNING: no policy specified for kudu/127.5.197.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
Entry for principal kudu/127.5.197.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab.
I20260807 20:00:13.620788 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:42939
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:13.955401 2475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:13.955708 2475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:13.955863 2475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:13.963021 2475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:13.963125 2475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:13.963274 2475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 20:00:13.972698 2475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.131.keytab
--principal=kudu/127.5.197.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:42939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:13.973961 2475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:13.975260 2475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:13.988411 2489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:13.988484 2487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:13.988456 2485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:13.989198 2475 server_base.cc:1034] running on GCE node
I20260807 20:00:13.989742 2475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:13.990615 2475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:13.991799 2475 hybrid_clock.cc:648] HybridClock initialized: now 1786132813991737 us; error 51 us; skew 500 ppm
I20260807 20:00:13.992105 2475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:13 dist-test-slave-6bbx krb5kdc[1974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132813, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:13.995290 2475 init.cc:377] Logged in from keytab as kudu/127.5.197.131@KRBTEST.COM (short username kudu)
I20260807 20:00:13.997040 2475 webserver.cc:460] Webserver started at http://127.5.197.131:34255/ using document root <none> and password file <none>
I20260807 20:00:13.997695 2475 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:13.997825 2475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:13.998136 2475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:14.001230 2475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "2de0bea534b84f5b8194b726820a3094"
format_stamp: "Formatted at 2026-08-07 20:00:13 on dist-test-slave-6bbx"
server_key: "ba68fc1dc2c9a2dcdaa252ba56d950a3"
server_key_iv: "99c2b4ae4a33718f1830eab5f2a828ab"
server_key_version: "encryptionkey@0"
I20260807 20:00:14.002076 2475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "2de0bea534b84f5b8194b726820a3094"
format_stamp: "Formatted at 2026-08-07 20:00:13 on dist-test-slave-6bbx"
server_key: "ba68fc1dc2c9a2dcdaa252ba56d950a3"
server_key_iv: "99c2b4ae4a33718f1830eab5f2a828ab"
server_key_version: "encryptionkey@0"
I20260807 20:00:14.007266 2475 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 20:00:14.010694 2499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:14.012008 2475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 20:00:14.012161 2475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "2de0bea534b84f5b8194b726820a3094"
format_stamp: "Formatted at 2026-08-07 20:00:13 on dist-test-slave-6bbx"
server_key: "ba68fc1dc2c9a2dcdaa252ba56d950a3"
server_key_iv: "99c2b4ae4a33718f1830eab5f2a828ab"
server_key_version: "encryptionkey@0"
I20260807 20:00:14.012331 2475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:14.023034 2475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:14.026885 2475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:14.027136 2475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:14.028034 2475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:14.029248 2475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:14.029321 2475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:14.029438 2475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:14.029488 2475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:14.035620 2288 heartbeater.cc:503] Master 127.5.197.190:42939 was elected leader, sending a full tablet report...
I20260807 20:00:14.059628 2475 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:35053
I20260807 20:00:14.059695 2649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:35053 every 8 connection(s)
I20260807 20:00:14.060886 2475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 20:00:14.070395 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 2475
I20260807 20:00:14.070565 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 20:00:14.070996 5910 external_mini_cluster.cc:1428] Setting key 9042d637e8e388f6f08878907cf37a89
Aug 07 20:00:14 dist-test-slave-6bbx krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132813, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.131@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:14.080195 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.063463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:46547 (local address 127.5.197.190:42939)
0807 20:00:14.063635 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.063639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.064766 (+ 1127us) server_negotiation.cc:407] Connection header received
0807 20:00:14.066651 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.066657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.066743 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.066840 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:14.068339 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.069146 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.070662 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.071068 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.071181 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.075183 (+ 4002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:14.075189 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:14.075192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:14.075229 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:14.077658 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.078332 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.078335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.078338 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.078457 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.078787 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.078790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.078792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.079041 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:14.079171 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.079771 (+ 600us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.079945 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 20:00:14.081104 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.063907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:42939 (local address 127.5.197.131:46547)
0807 20:00:14.064613 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.064654 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:14.066396 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:14.067074 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:14.067083 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:14.067587 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:14.068177 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.068195 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.069297 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.069301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.070523 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.070540 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.071306 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.071317 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.071584 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.072453 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:14.072478 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:14.074964 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:14.077791 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:14.077797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:14.077821 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:14.078243 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:14.078532 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:14.078535 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:14.078537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:14.078707 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:14.079137 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:14.079142 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:14.079438 (+ 296us) client_negotiation.cc:769] Sending connection context
0807 20:00:14.079653 (+ 215us) client_negotiation.cc:240] Negotiation successful
0807 20:00:14.080079 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":261,"threads_started":1}
I20260807 20:00:14.082347 2650 heartbeater.cc:347] Connected to a master server at 127.5.197.190:42939
I20260807 20:00:14.082630 2650 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:14.083307 2650 heartbeater.cc:511] Master 127.5.197.190:42939 requested a full tablet report, sending...
I20260807 20:00:14.084743 2033 ts_manager.cc:194] Registered new tserver with Master: 2de0bea534b84f5b8194b726820a3094 (127.5.197.131:35053)
I20260807 20:00:14.085624 2033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.197.131@KRBTEST.COM'} at 127.5.197.131:46547
I20260807 20:00:14.086264 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:00:14.102500 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.090982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39548 (local address 127.5.197.190:42939)
0807 20:00:14.091177 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.091183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.091551 (+ 368us) server_negotiation.cc:407] Connection header received
0807 20:00:14.091711 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.091723 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.091791 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.091870 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:14.093223 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.094011 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.095251 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.095654 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.095803 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.097956 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:14.097960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:14.097963 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:14.097988 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:14.100294 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.100858 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.100861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.100863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.100971 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.101235 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.101238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.101240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.101530 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:14.101711 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.101995 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.102197 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 20:00:14.106019 2032 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:00:14.112756 2032 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:00:14.145334 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.124292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:46229 (local address 127.0.0.1:51756)
0807 20:00:14.136343 (+ 12051us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.136391 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:14.136563 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:14.137480 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:14.137488 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:14.137530 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:14.138092 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.138107 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.139990 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.139996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.142466 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.142481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.144348 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.144354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.144541 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.144593 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 20:00:14.144716 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 20:00:14.144903 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11804,"mutex_wait_us":21,"thread_start_us":13501,"threads_started":1}
I20260807 20:00:14.146111 2671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.124351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51756 (local address 127.5.197.130:46229)
0807 20:00:14.136848 (+ 12497us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.136857 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.136889 (+ 32us) server_negotiation.cc:407] Connection header received
0807 20:00:14.136999 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.137006 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.137248 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.137469 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:14.138329 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.139846 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.142637 (+ 2791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.144124 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.144273 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.145542 (+ 1269us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.145624 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.145789 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12104,"thread_start_us":12222,"threads_started":1}
I20260807 20:00:14.146296 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.126699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55624)
0807 20:00:14.138722 (+ 12023us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.138739 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:14.138842 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:14.139463 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:14.139467 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:14.139588 (+ 121us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:14.140093 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.140112 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.141987 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.141992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.143645 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.143657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.145489 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.145495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.145655 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.145686 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 20:00:14.145776 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 20:00:14.145898 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11920,"mutex_wait_us":25,"thread_start_us":11768,"threads_started":1}
I20260807 20:00:14.146865 2677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.127369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55624 (local address 127.5.197.129:39349)
0807 20:00:14.138535 (+ 11166us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.138544 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.138958 (+ 414us) server_negotiation.cc:407] Connection header received
0807 20:00:14.139060 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.139066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.139282 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.139441 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:14.140279 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.141812 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.143818 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.145006 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.145133 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.145336 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.146490 (+ 1154us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.146608 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10998,"thread_start_us":10832,"threads_started":1}
I20260807 20:00:14.146905 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.124302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:35053 (local address 127.0.0.1:60234)
0807 20:00:14.138099 (+ 13797us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.138116 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:14.138229 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:14.139739 (+ 1510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:14.139744 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:14.139764 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:14.140334 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.140344 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.142063 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.142068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.144148 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.144162 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.146103 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.146139 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.146328 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.146361 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:00:14.146443 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 20:00:14.146559 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13664,"mutex_wait_us":72,"thread_start_us":11656,"threads_started":1}
I20260807 20:00:14.147487 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.124793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60234 (local address 127.5.197.131:35053)
0807 20:00:14.139024 (+ 14231us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.139032 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.139064 (+ 32us) server_negotiation.cc:407] Connection header received
0807 20:00:14.139152 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.139159 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.139380 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.139550 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:14.140502 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.141891 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.144318 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.145624 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.145741 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.145953 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.147054 (+ 1101us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.147219 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14059,"thread_start_us":14193,"threads_started":1}
I20260807 20:00:14.150467 2564 tablet_service.cc:1467] Processing CreateTablet for tablet 46b405e332774f61bf0ff90dd884421a (DEFAULT_TABLE table=test-table [id=dd9539d88d264f64b9eeecceb88b2b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:14.150297 2382 tablet_service.cc:1467] Processing CreateTablet for tablet 46b405e332774f61bf0ff90dd884421a (DEFAULT_TABLE table=test-table [id=dd9539d88d264f64b9eeecceb88b2b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:14.150578 2196 tablet_service.cc:1467] Processing CreateTablet for tablet 46b405e332774f61bf0ff90dd884421a (DEFAULT_TABLE table=test-table [id=dd9539d88d264f64b9eeecceb88b2b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:14.151844 2382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46b405e332774f61bf0ff90dd884421a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:14.151849 2196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46b405e332774f61bf0ff90dd884421a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:14.152129 2564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46b405e332774f61bf0ff90dd884421a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:14.163653 2679 tablet_bootstrap.cc:492] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Bootstrap starting.
I20260807 20:00:14.165952 2680 tablet_bootstrap.cc:492] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: Bootstrap starting.
I20260807 20:00:14.167419 2681 tablet_bootstrap.cc:492] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Bootstrap starting.
I20260807 20:00:14.167994 2679 tablet_bootstrap.cc:654] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:14.169375 2679 log.cc:824] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:14.169474 2680 tablet_bootstrap.cc:654] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:14.170435 2681 tablet_bootstrap.cc:654] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:14.170823 2680 log.cc:824] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:14.171384 2681 log.cc:824] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:14.174048 2680 tablet_bootstrap.cc:492] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: No bootstrap required, opened a new log
I20260807 20:00:14.174341 2680 ts_tablet_manager.cc:1397] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260807 20:00:14.174533 2681 tablet_bootstrap.cc:492] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: No bootstrap required, opened a new log
I20260807 20:00:14.174630 2679 tablet_bootstrap.cc:492] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: No bootstrap required, opened a new log
I20260807 20:00:14.174785 2681 ts_tablet_manager.cc:1397] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 20:00:14.174889 2679 ts_tablet_manager.cc:1397] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260807 20:00:14.181953 2681 raft_consensus.cc:348] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.182452 2681 raft_consensus.cc:374] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:14.182552 2681 raft_consensus.cc:729] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50c70785ffcc43c0ba06a9f585c19c44, State: Initialized, Role: FOLLOWER
I20260807 20:00:14.183137 2681 consensus_queue.cc:260] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.184268 2469 heartbeater.cc:503] Master 127.5.197.190:42939 was elected leader, sending a full tablet report...
I20260807 20:00:14.184836 2681 ts_tablet_manager.cc:1428] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Time spent starting tablet: real 0.010s user 0.008s sys 0.003s
I20260807 20:00:14.184857 2680 raft_consensus.cc:348] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.185348 2680 raft_consensus.cc:374] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:14.185453 2680 raft_consensus.cc:729] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958994f7578244ce9a9347e9c3b0d3c9, State: Initialized, Role: FOLLOWER
I20260807 20:00:14.186000 2680 consensus_queue.cc:260] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.185904 2679 raft_consensus.cc:348] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.186318 2679 raft_consensus.cc:374] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:14.186432 2679 raft_consensus.cc:729] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de0bea534b84f5b8194b726820a3094, State: Initialized, Role: FOLLOWER
I20260807 20:00:14.186998 2679 consensus_queue.cc:260] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.187760 2680 ts_tablet_manager.cc:1428] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: Time spent starting tablet: real 0.013s user 0.011s sys 0.004s
I20260807 20:00:14.188743 2650 heartbeater.cc:503] Master 127.5.197.190:42939 was elected leader, sending a full tablet report...
I20260807 20:00:14.189785 2679 ts_tablet_manager.cc:1428] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260807 20:00:14.219550 2685 raft_consensus.cc:482] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:00:14.219890 2685 raft_consensus.cc:504] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.221578 2685 leader_election.cc:288] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2de0bea534b84f5b8194b726820a3094 (127.5.197.131:35053), 958994f7578244ce9a9347e9c3b0d3c9 (127.5.197.129:39349)
I20260807 20:00:14.228165 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.222058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:43485 (local address 127.5.197.131:35053)
0807 20:00:14.222279 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.222286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.222985 (+ 699us) server_negotiation.cc:407] Connection header received
0807 20:00:14.223168 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.223172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.223231 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.223305 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:14.223925 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.224678 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.226486 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.227227 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.227374 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.227450 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.227774 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.227912 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 20:00:14.228219 2677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.222101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:40483 (local address 127.5.197.129:39349)
0807 20:00:14.222319 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.222326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.223069 (+ 743us) server_negotiation.cc:407] Connection header received
0807 20:00:14.223238 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.223243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.223304 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.223377 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:14.224033 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.224752 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.226486 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.227238 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.227380 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.227452 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.227865 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.227998 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 20:00:14.228314 2689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.222086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.5.197.130:40483)
0807 20:00:14.222967 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.222981 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:14.223100 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:14.223402 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:14.223406 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:14.223434 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:14.223876 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.223886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.224893 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.224898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.226326 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.226337 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.227500 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.227508 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.227639 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.227707 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 20:00:14.227801 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 20:00:14.227917 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"mutex_wait_us":4,"thread_start_us":473,"threads_started":1}
I20260807 20:00:14.228694 2688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.222005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:35053 (local address 127.5.197.130:43485)
0807 20:00:14.222881 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.222902 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:14.223040 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:14.223346 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:14.223351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:14.223374 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:14.223788 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.223798 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.224803 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.224808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.226340 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:14.226352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.227472 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.227482 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:14.227602 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.227625 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 20:00:14.227744 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 20:00:14.227860 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"mutex_wait_us":7,"spinlock_wait_cycles":4352,"thread_start_us":472,"threads_started":1}
I20260807 20:00:14.229364 2223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b405e332774f61bf0ff90dd884421a" candidate_uuid: "50c70785ffcc43c0ba06a9f585c19c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958994f7578244ce9a9347e9c3b0d3c9" is_pre_election: true
I20260807 20:00:14.229650 2587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b405e332774f61bf0ff90dd884421a" candidate_uuid: "50c70785ffcc43c0ba06a9f585c19c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de0bea534b84f5b8194b726820a3094" is_pre_election: true
I20260807 20:00:14.229995 2223 raft_consensus.cc:2454] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50c70785ffcc43c0ba06a9f585c19c44 in term 0.
I20260807 20:00:14.230206 2587 raft_consensus.cc:2454] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50c70785ffcc43c0ba06a9f585c19c44 in term 0.
I20260807 20:00:14.230710 2319 leader_election.cc:302] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50c70785ffcc43c0ba06a9f585c19c44, 958994f7578244ce9a9347e9c3b0d3c9; no voters:
I20260807 20:00:14.231071 2685 raft_consensus.cc:2781] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:00:14.231206 2685 raft_consensus.cc:482] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:00:14.231299 2685 raft_consensus.cc:3037] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:14.233543 2685 raft_consensus.cc:504] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.234135 2685 leader_election.cc:288] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [CANDIDATE]: Term 1 election: Requested vote from peers 2de0bea534b84f5b8194b726820a3094 (127.5.197.131:35053), 958994f7578244ce9a9347e9c3b0d3c9 (127.5.197.129:39349)
I20260807 20:00:14.234563 2587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b405e332774f61bf0ff90dd884421a" candidate_uuid: "50c70785ffcc43c0ba06a9f585c19c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de0bea534b84f5b8194b726820a3094"
I20260807 20:00:14.234670 2223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b405e332774f61bf0ff90dd884421a" candidate_uuid: "50c70785ffcc43c0ba06a9f585c19c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "958994f7578244ce9a9347e9c3b0d3c9"
I20260807 20:00:14.234771 2587 raft_consensus.cc:3037] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:14.234887 2223 raft_consensus.cc:3037] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:14.237222 2587 raft_consensus.cc:2454] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50c70785ffcc43c0ba06a9f585c19c44 in term 1.
I20260807 20:00:14.237330 2223 raft_consensus.cc:2454] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50c70785ffcc43c0ba06a9f585c19c44 in term 1.
I20260807 20:00:14.237668 2318 leader_election.cc:302] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de0bea534b84f5b8194b726820a3094, 50c70785ffcc43c0ba06a9f585c19c44; no voters:
I20260807 20:00:14.238003 2685 raft_consensus.cc:2781] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:14.238469 2685 raft_consensus.cc:686] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 1 LEADER]: Becoming Leader. State: Replica: 50c70785ffcc43c0ba06a9f585c19c44, State: Running, Role: LEADER
I20260807 20:00:14.239006 2685 consensus_queue.cc:237] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } }
I20260807 20:00:14.243392 2031 catalog_manager.cc:5495] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50c70785ffcc43c0ba06a9f585c19c44 (127.5.197.130). New cstate: current_term: 1 leader_uuid: "50c70785ffcc43c0ba06a9f585c19c44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50c70785ffcc43c0ba06a9f585c19c44" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 46229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 } health_report { overall_health: UNKNOWN } } }
W20260807 20:00:14.257718 2289 tablet.cc:2369] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:14.274189 2671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.269048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51772 (local address 127.5.197.130:46229)
0807 20:00:14.269272 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.269279 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.269333 (+ 54us) server_negotiation.cc:407] Connection header received
0807 20:00:14.269517 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.269520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.269599 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.269726 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:00:14.270071 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.270797 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.272125 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.272525 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.272613 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.273154 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:00:14.273647 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:00:14.273764 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.273855 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.273920 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 20:00:14.282058 2223 raft_consensus.cc:1261] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9 [term 1 FOLLOWER]: Refusing update from remote peer 50c70785ffcc43c0ba06a9f585c19c44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:14.282090 2587 raft_consensus.cc:1261] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 1 FOLLOWER]: Refusing update from remote peer 50c70785ffcc43c0ba06a9f585c19c44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:14.283030 2690 consensus_queue.cc:1035] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958994f7578244ce9a9347e9c3b0d3c9" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:14.283375 2685 consensus_queue.cc:1035] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2de0bea534b84f5b8194b726820a3094" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 35053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:14.294015 2693 mvcc.cc:205] Tried to move back new op lower bound from 7316000007290028032 to 7316000007126953984. Current Snapshot: MvccSnapshot[applied={T|T < 7316000007290028032}]
I20260807 20:00:14.299261 2694 mvcc.cc:205] Tried to move back new op lower bound from 7316000007290028032 to 7316000007126953984. Current Snapshot: MvccSnapshot[applied={T|T < 7316000007290028032}]
I20260807 20:00:14.306576 2033 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:14.306830 2033 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:14.310364 2033 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 31a6546152474890a17a36c88cccf8d2: Sending DeleteTablet for 3 replicas of tablet 46b405e332774f61bf0ff90dd884421a
I20260807 20:00:14.311461 2382 tablet_service.cc:1514] Processing DeleteTablet for tablet 46b405e332774f61bf0ff90dd884421a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:14 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:51756
I20260807 20:00:14.311491 2564 tablet_service.cc:1514] Processing DeleteTablet for tablet 46b405e332774f61bf0ff90dd884421a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:14 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:60234
I20260807 20:00:14.311892 2196 tablet_service.cc:1514] Processing DeleteTablet for tablet 46b405e332774f61bf0ff90dd884421a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:14 UTC) from {username='kudu', principal='kudu/127.5.197.190@KRBTEST.COM'} at 127.0.0.1:55624
I20260807 20:00:14.312412 2708 tablet_replica.cc:330] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: stopping tablet replica
I20260807 20:00:14.313340 2708 raft_consensus.cc:2229] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:14.313427 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 2114
I20260807 20:00:14.313889 2708 raft_consensus.cc:2258] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:14.314687 2707 tablet_replica.cc:330] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: stopping tablet replica
I20260807 20:00:14.315125 2707 raft_consensus.cc:2229] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:00:14.315876 2707 raft_consensus.cc:2258] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:14.321897 2708 ts_tablet_manager.cc:1905] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 20:00:14 dist-test-slave-6bbx krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.129@KRBTEST.COM
I20260807 20:00:14.326642 2707 ts_tablet_manager.cc:1905] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:14.334220 2707 ts_tablet_manager.cc:1918] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:14.334237 2708 ts_tablet_manager.cc:1918] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:14.334401 2708 log.cc:1196] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/46b405e332774f61bf0ff90dd884421a
I20260807 20:00:14.334401 2707 log.cc:1196] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/46b405e332774f61bf0ff90dd884421a
I20260807 20:00:14.334944 2708 ts_tablet_manager.cc:1939] T 46b405e332774f61bf0ff90dd884421a P 2de0bea534b84f5b8194b726820a3094: Deleting consensus metadata
I20260807 20:00:14.335732 2677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.315752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55634 (local address 127.5.197.129:39349)
0807 20:00:14.315930 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.315936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.315955 (+ 19us) server_negotiation.cc:407] Connection header received
0807 20:00:14.316009 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.316014 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.316087 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.316189 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:14.317854 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.319154 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.321128 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.321743 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.321891 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.326954 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:14.326969 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:14.326985 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:14.327031 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:14.331320 (+ 4289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.332262 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.332271 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.332275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.332438 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.332846 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.332851 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.332854 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.333318 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:14.333594 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.334655 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.334888 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 20:00:14.336730 2280 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:14.336835 2707 ts_tablet_manager.cc:1939] T 46b405e332774f61bf0ff90dd884421a P 50c70785ffcc43c0ba06a9f585c19c44: Deleting consensus metadata
I20260807 20:00:14.336980 2012 catalog_manager.cc:4841] TS 2de0bea534b84f5b8194b726820a3094 (127.5.197.131:35053): tablet 46b405e332774f61bf0ff90dd884421a (table test-table [id=dd9539d88d264f64b9eeecceb88b2b9e]) successfully deleted
I20260807 20:00:14.338523 2011 catalog_manager.cc:4841] TS 50c70785ffcc43c0ba06a9f585c19c44 (127.5.197.130:46229): tablet 46b405e332774f61bf0ff90dd884421a (table test-table [id=dd9539d88d264f64b9eeecceb88b2b9e]) successfully deleted
I20260807 20:00:14.436882 2710 tablet_replica.cc:330] T 46b405e332774f61bf0ff90dd884421a P 958994f7578244ce9a9347e9c3b0d3c9: stopping tablet replica
I20260807 20:00:14.437134 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 2114
W20260807 20:00:14.465847 2014 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.197.129:39349 (error 108)
I20260807 20:00:14.466650 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 2294
I20260807 20:00:14.468011 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.467409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55644)
0807 20:00:14.467701 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.467832 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
W20260807 20:00:14.468240 2014 catalog_manager.cc:4584] TS 958994f7578244ce9a9347e9c3b0d3c9 (127.5.197.129:39349): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 46b405e332774f61bf0ff90dd884421a: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Aug 07 20:00:14 dist-test-slave-6bbx krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.130@KRBTEST.COM
I20260807 20:00:14.483363 2671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.467434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51782 (local address 127.5.197.130:46229)
0807 20:00:14.467622 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.467626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.467888 (+ 262us) server_negotiation.cc:407] Connection header received
0807 20:00:14.468086 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.468091 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.468203 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.468319 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:14.469759 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.470920 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.472226 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.472891 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.473023 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.477447 (+ 4424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:14.477461 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:14.477477 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:14.477515 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:14.480549 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.481426 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.481433 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.481436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.481574 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.481970 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.481973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.481975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.482333 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:14.482596 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.482914 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.483078 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 20:00:14.484115 2462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:14.522053 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.521555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55650)
0807 20:00:14.521775 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.521889 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 20:00:14.523056 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.522707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55656)
0807 20:00:14.522862 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.522944 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 20:00:14.583397 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.582923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55660)
0807 20:00:14.583146 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.583232 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 20:00:14.584545 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.584184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55670)
0807 20:00:14.584347 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.584421 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 20:00:14.604044 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 2294
I20260807 20:00:14.630421 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 2475
Aug 07 20:00:14 dist-test-slave-6bbx krb5kdc[1974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.131@KRBTEST.COM
I20260807 20:00:14.645047 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.631169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60244 (local address 127.5.197.131:35053)
0807 20:00:14.631354 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:14.631359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:14.631378 (+ 19us) server_negotiation.cc:407] Connection header received
0807 20:00:14.631579 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:14.631583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:14.631649 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:14.631790 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:14.633110 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.633917 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.635158 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:14.635562 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:14.635702 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:14.640059 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:14.640074 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:14.640092 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:14.640125 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:14.642575 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.643215 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.643222 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.643224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.643374 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:14.643656 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:14.643659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:14.643772 (+ 113us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:14.644127 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:14.644357 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:14.644640 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 20:00:14.644803 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 20:00:14.645721 2643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:14.664851 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.664436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55682)
0807 20:00:14.664619 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.664702 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 20:00:14.665887 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.665502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55692)
0807 20:00:14.665699 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.665767 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 20:00:14.733464 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 2475
I20260807 20:00:14.756431 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 1993
I20260807 20:00:14.757663 2075 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:14.868960 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:14.868172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:39349 (local address 127.0.0.1:55702)
0807 20:00:14.868519 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:14.868654 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.129:39349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161}
I20260807 20:00:14.869004 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 1993
2026-08-07T20:00:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4513 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T20:00:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:14Z Disabled control of system clock
I20260807 20:00:14.960646 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45461
--webserver_interface=127.5.197.190
--webserver_port=0
--builtin_ntp_servers=127.5.197.148:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:00:15.302073 2724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:15.302390 2724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:15.302518 2724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:15.309588 2724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:15.309691 2724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:15.309753 2724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:15.309834 2724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:15.309892 2724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:15.318884 2724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45461
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:15.320209 2724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:15.322044 2724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:15.333420 2733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:15.333500 2735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:15.333420 2732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:15.334414 2724 server_base.cc:1034] running on GCE node
I20260807 20:00:15.335134 2724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:15.336542 2724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:15.337745 2724 hybrid_clock.cc:648] HybridClock initialized: now 1786132815337702 us; error 32 us; skew 500 ppm
I20260807 20:00:15.338059 2724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:15.340205 2724 webserver.cc:460] Webserver started at http://127.5.197.190:32961/ using document root <none> and password file <none>
I20260807 20:00:15.340852 2724 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:15.340939 2724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:15.341207 2724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:15.344070 2724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "eb55d55e8918491e9022edeb8dfcda63"
format_stamp: "Formatted at 2026-08-07 20:00:15 on dist-test-slave-6bbx"
server_key: "58259bf1f84c0335bf7c2fe3a0b86264"
server_key_iv: "2eb976692ef1a5b206196a45dc085cde"
server_key_version: "encryptionkey@0"
I20260807 20:00:15.344820 2724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "eb55d55e8918491e9022edeb8dfcda63"
format_stamp: "Formatted at 2026-08-07 20:00:15 on dist-test-slave-6bbx"
server_key: "58259bf1f84c0335bf7c2fe3a0b86264"
server_key_iv: "2eb976692ef1a5b206196a45dc085cde"
server_key_version: "encryptionkey@0"
I20260807 20:00:15.349730 2724 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 20:00:15.353034 2743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:15.354254 2724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:15.354398 2724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "eb55d55e8918491e9022edeb8dfcda63"
format_stamp: "Formatted at 2026-08-07 20:00:15 on dist-test-slave-6bbx"
server_key: "58259bf1f84c0335bf7c2fe3a0b86264"
server_key_iv: "2eb976692ef1a5b206196a45dc085cde"
server_key_version: "encryptionkey@0"
I20260807 20:00:15.354573 2724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:15.376134 2724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:15.376904 2724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:15.377141 2724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:15.394438 2724 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:45461
I20260807 20:00:15.394444 2812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:45461 every 8 connection(s)
I20260807 20:00:15.395767 2724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:15.399514 2813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:15.403825 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 2724
I20260807 20:00:15.403992 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:15.404453 5910 external_mini_cluster.cc:1428] Setting key 720fb1dbd266291f955605c98a92484e
I20260807 20:00:15.410492 2813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63: Bootstrap starting.
I20260807 20:00:15.413976 2813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:15.415148 2813 log.cc:824] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:15.418149 2813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63: No bootstrap required, opened a new log
I20260807 20:00:15.418210 2817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:15.406255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48302 (local address 127.5.197.190:45461)
0807 20:00:15.407193 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:15.407203 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:15.407246 (+ 43us) server_negotiation.cc:407] Connection header received
0807 20:00:15.409137 (+ 1891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:15.409164 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:15.409715 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:15.410021 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:15.410626 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:15.411991 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:15.413822 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:15.414571 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:15.414709 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:15.415950 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:15.415961 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:15.415978 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:15.416653 (+ 675us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:15.416732 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:15.416752 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:15.416834 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:15.417048 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 20:00:15.417349 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":326,"threads_started":1}
I20260807 20:00:15.426070 2813 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb55d55e8918491e9022edeb8dfcda63" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45461 } }
I20260807 20:00:15.426397 2813 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:15.426501 2813 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb55d55e8918491e9022edeb8dfcda63, State: Initialized, Role: FOLLOWER
I20260807 20:00:15.427031 2813 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb55d55e8918491e9022edeb8dfcda63" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45461 } }
I20260807 20:00:15.427248 2813 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:15.427376 2813 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:15.427520 2813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:15.429605 2813 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb55d55e8918491e9022edeb8dfcda63" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45461 } }
I20260807 20:00:15.430068 2813 leader_election.cc:302] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb55d55e8918491e9022edeb8dfcda63; no voters:
I20260807 20:00:15.430598 2813 leader_election.cc:288] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:15.430745 2819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:15.431414 2819 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [term 1 LEADER]: Becoming Leader. State: Replica: eb55d55e8918491e9022edeb8dfcda63, State: Running, Role: LEADER
I20260807 20:00:15.431954 2819 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb55d55e8918491e9022edeb8dfcda63" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45461 } }
I20260807 20:00:15.432556 2813 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:15.434873 2820 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb55d55e8918491e9022edeb8dfcda63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb55d55e8918491e9022edeb8dfcda63" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45461 } } }
I20260807 20:00:15.434896 2822 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb55d55e8918491e9022edeb8dfcda63. Latest consensus state: current_term: 1 leader_uuid: "eb55d55e8918491e9022edeb8dfcda63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb55d55e8918491e9022edeb8dfcda63" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45461 } } }
I20260807 20:00:15.435302 2820 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:15.435302 2822 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63 [sys.catalog]: This master's current role is: LEADER
W20260807 20:00:15.445528 2838 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:00:15.445638 2838 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:00:15.445796 2827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:15.447980 2827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:15.456733 2827 catalog_manager.cc:1347] Generated new cluster ID: 87270993749c4ad591802e90a86bd579
I20260807 20:00:15.456847 2827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:15.477474 2827 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:15.479228 2827 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:15.486994 2827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63: Generated new TSK 0
I20260807 20:00:15.488070 2827 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:15.492646 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.129:0
--local_ip_for_outbound_sockets=127.5.197.129
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45461
--builtin_ntp_servers=127.5.197.148:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:00:15.832314 2841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:15.832588 2841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:15.832726 2841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:15.839900 2841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:15.840003 2841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:15.840155 2841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.129
I20260807 20:00:15.849154 2841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.197.129
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45461
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.129
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:15.850559 2841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:15.852504 2841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:15.865463 2848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:15.865506 2850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:15.865581 2852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:15.866253 2841 server_base.cc:1034] running on GCE node
I20260807 20:00:15.866843 2841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:15.867794 2841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:15.869033 2841 hybrid_clock.cc:648] HybridClock initialized: now 1786132815868968 us; error 49 us; skew 500 ppm
I20260807 20:00:15.869370 2841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:15.871505 2841 webserver.cc:460] Webserver started at http://127.5.197.129:34531/ using document root <none> and password file <none>
I20260807 20:00:15.872222 2841 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:15.872331 2841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:15.872637 2841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:15.875411 2841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data/instance:
uuid: "3a5423fd531e4949ad952c11086fa661"
format_stamp: "Formatted at 2026-08-07 20:00:15 on dist-test-slave-6bbx"
server_key: "a5284127d62c35b33c3b7eee66f35829"
server_key_iv: "a1fc1c8ac0e54b612b3a2463aa5e012c"
server_key_version: "encryptionkey@0"
I20260807 20:00:15.876223 2841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance:
uuid: "3a5423fd531e4949ad952c11086fa661"
format_stamp: "Formatted at 2026-08-07 20:00:15 on dist-test-slave-6bbx"
server_key: "a5284127d62c35b33c3b7eee66f35829"
server_key_iv: "a1fc1c8ac0e54b612b3a2463aa5e012c"
server_key_version: "encryptionkey@0"
I20260807 20:00:15.881109 2841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 20:00:15.884479 2862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:15.885726 2841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 20:00:15.885881 2841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal
uuid: "3a5423fd531e4949ad952c11086fa661"
format_stamp: "Formatted at 2026-08-07 20:00:15 on dist-test-slave-6bbx"
server_key: "a5284127d62c35b33c3b7eee66f35829"
server_key_iv: "a1fc1c8ac0e54b612b3a2463aa5e012c"
server_key_version: "encryptionkey@0"
I20260807 20:00:15.886081 2841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:15.907348 2841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:15.908211 2841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:15.908512 2841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:15.909483 2841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:15.910948 2841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:15.911046 2841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:15.911152 2841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:15.911231 2841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:15.942255 2841 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.129:44243
I20260807 20:00:15.942348 3021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.129:44243 every 8 connection(s)
I20260807 20:00:15.943533 2841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/data/info.pb
I20260807 20:00:15.945447 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 2841
I20260807 20:00:15.945621 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal/instance
I20260807 20:00:15.946178 5910 external_mini_cluster.cc:1428] Setting key 8f026b0dfc061f99161154c44cd97203
I20260807 20:00:15.949077 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.130:0
--local_ip_for_outbound_sockets=127.5.197.130
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45461
--builtin_ntp_servers=127.5.197.148:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:00:15.955919 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:15.946022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.129:37975 (local address 127.5.197.190:45461)
0807 20:00:15.946429 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:15.946434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:15.947860 (+ 1426us) server_negotiation.cc:407] Connection header received
0807 20:00:15.949746 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:15.949751 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:15.949840 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:15.949932 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:15.950971 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:15.951740 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:15.953254 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:15.953661 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:15.953769 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:15.955008 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:15.955014 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:15.955019 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:15.955036 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:15.955085 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:15.955097 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:15.955171 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:15.955386 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 20:00:15.955481 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":198,"threads_started":1}
I20260807 20:00:15.956779 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:15.946749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45461 (local address 127.5.197.129:37975)
0807 20:00:15.947710 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:15.947754 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:15.949497 (+ 1743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:15.950161 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:15.950170 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:15.950252 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:15.950809 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:15.950827 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:15.951891 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:15.951896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:15.953114 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:15.953127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:15.953870 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:15.953878 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:15.954087 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:15.954717 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:15.954719 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:15.954757 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:15.954836 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:15.955185 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:15.955196 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:15.955205 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 20:00:15.955359 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 20:00:15.955747 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":288,"threads_started":1}
I20260807 20:00:15.958140 3023 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45461
I20260807 20:00:15.958415 3023 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:15.959177 3023 heartbeater.cc:511] Master 127.5.197.190:45461 requested a full tablet report, sending...
I20260807 20:00:15.961156 2764 ts_manager.cc:194] Registered new tserver with Master: 3a5423fd531e4949ad952c11086fa661 (127.5.197.129:44243)
I20260807 20:00:15.962680 2764 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.129:37975
W20260807 20:00:16.286746 3029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:16.287022 3029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:16.287148 3029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:16.294268 3029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:16.294365 3029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:16.294498 3029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.130
I20260807 20:00:16.303360 3029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.197.130
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45461
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.130
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:16.304629 3029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:16.306456 3029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:16.318980 3039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:16.318944 3037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:16.319157 3036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:16.319625 3029 server_base.cc:1034] running on GCE node
I20260807 20:00:16.320206 3029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:16.321055 3029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:16.322247 3029 hybrid_clock.cc:648] HybridClock initialized: now 1786132816322181 us; error 58 us; skew 500 ppm
I20260807 20:00:16.322520 3029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:16.324692 3029 webserver.cc:460] Webserver started at http://127.5.197.130:39373/ using document root <none> and password file <none>
I20260807 20:00:16.325335 3029 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:16.325419 3029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:16.325683 3029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:16.328508 3029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data/instance:
uuid: "369b250439114279877a55d558b08d83"
format_stamp: "Formatted at 2026-08-07 20:00:16 on dist-test-slave-6bbx"
server_key: "258c6266d4058ac7c79a0e2281648c34"
server_key_iv: "0904cb46af7abe6455c4b6b2c497840f"
server_key_version: "encryptionkey@0"
I20260807 20:00:16.329246 3029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance:
uuid: "369b250439114279877a55d558b08d83"
format_stamp: "Formatted at 2026-08-07 20:00:16 on dist-test-slave-6bbx"
server_key: "258c6266d4058ac7c79a0e2281648c34"
server_key_iv: "0904cb46af7abe6455c4b6b2c497840f"
server_key_version: "encryptionkey@0"
I20260807 20:00:16.334389 3029 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 20:00:16.337829 3048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:16.339157 3029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:16.339315 3029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal
uuid: "369b250439114279877a55d558b08d83"
format_stamp: "Formatted at 2026-08-07 20:00:16 on dist-test-slave-6bbx"
server_key: "258c6266d4058ac7c79a0e2281648c34"
server_key_iv: "0904cb46af7abe6455c4b6b2c497840f"
server_key_version: "encryptionkey@0"
I20260807 20:00:16.339524 3029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:16.356487 3029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:16.357239 3029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:16.357568 3029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:16.358556 3029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:16.360004 3029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:16.360105 3029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:16.360205 3029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:16.360271 3029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:16.389564 3029 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.130:42663
I20260807 20:00:16.389626 3197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.130:42663 every 8 connection(s)
I20260807 20:00:16.390903 3029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/data/info.pb
I20260807 20:00:16.392776 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 3029
I20260807 20:00:16.392959 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal/instance
I20260807 20:00:16.393430 5910 external_mini_cluster.cc:1428] Setting key 0fa6484cfe2fa0ededb02408ab4ea61e
I20260807 20:00:16.396561 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.197.131:0
--local_ip_for_outbound_sockets=127.5.197.131
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45461
--builtin_ntp_servers=127.5.197.148:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:00:16.405753 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.393681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.130:42299 (local address 127.5.197.190:45461)
0807 20:00:16.393887 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:16.393894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:16.395592 (+ 1698us) server_negotiation.cc:407] Connection header received
0807 20:00:16.398101 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:16.398106 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:16.398186 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:16.398295 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:16.399641 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.400636 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.402883 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.403410 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.403525 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.404986 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:16.404992 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:16.404996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:16.405016 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:16.405053 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:16.405068 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:16.405149 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:16.405363 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 20:00:16.405452 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 20:00:16.406956 3202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.394331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45461 (local address 127.5.197.130:42299)
0807 20:00:16.395404 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:16.395461 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:16.397804 (+ 2343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:16.398542 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:16.398553 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:16.398659 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:16.399449 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.399476 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.400787 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.400793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.402723 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.402738 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.403627 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.403634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.403925 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.404644 (+ 719us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:16.404648 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:16.404699 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:16.404795 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:16.405162 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:16.405171 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:16.405179 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 20:00:16.405338 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 20:00:16.405728 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":314,"threads_started":1}
I20260807 20:00:16.408705 3198 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45461
I20260807 20:00:16.409006 3198 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:16.409917 3198 heartbeater.cc:511] Master 127.5.197.190:45461 requested a full tablet report, sending...
I20260807 20:00:16.411995 2764 ts_manager.cc:194] Registered new tserver with Master: 369b250439114279877a55d558b08d83 (127.5.197.130:42663)
I20260807 20:00:16.413043 2764 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.130:42299
W20260807 20:00:16.736850 3203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:16.737140 3203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:16.737282 3203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:16.744542 3203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:16.744650 3203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:16.744793 3203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.197.131
I20260807 20:00:16.753705 3203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.197.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.197.131
--webserver_port=0
--tserver_master_addrs=127.5.197.190:45461
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.197.131
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:16.754957 3203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:16.756822 3203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:16.769372 3213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:16.769395 3211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:16.770017 3209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:16.770058 3203 server_base.cc:1034] running on GCE node
I20260807 20:00:16.770700 3203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:16.771606 3203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:16.772825 3203 hybrid_clock.cc:648] HybridClock initialized: now 1786132816772772 us; error 44 us; skew 500 ppm
I20260807 20:00:16.773106 3203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 20:00:16.775476 3203 webserver.cc:460] Webserver started at http://127.5.197.131:42945/ using document root <none> and password file <none>
I20260807 20:00:16.776173 3203 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:16.776280 3203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:16.776593 3203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:16.779384 3203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data/instance:
uuid: "3fd9457fd7464da6b11b8365d593f378"
format_stamp: "Formatted at 2026-08-07 20:00:16 on dist-test-slave-6bbx"
server_key: "c0a97bbd80a4be3580a7de8b9d210f6f"
server_key_iv: "70ab2248f623f240439ba7d94d30f562"
server_key_version: "encryptionkey@0"
I20260807 20:00:16.780153 3203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance:
uuid: "3fd9457fd7464da6b11b8365d593f378"
format_stamp: "Formatted at 2026-08-07 20:00:16 on dist-test-slave-6bbx"
server_key: "c0a97bbd80a4be3580a7de8b9d210f6f"
server_key_iv: "70ab2248f623f240439ba7d94d30f562"
server_key_version: "encryptionkey@0"
I20260807 20:00:16.785024 3203 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 20:00:16.788368 3222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:16.789651 3203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:16.789800 3203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal
uuid: "3fd9457fd7464da6b11b8365d593f378"
format_stamp: "Formatted at 2026-08-07 20:00:16 on dist-test-slave-6bbx"
server_key: "c0a97bbd80a4be3580a7de8b9d210f6f"
server_key_iv: "70ab2248f623f240439ba7d94d30f562"
server_key_version: "encryptionkey@0"
I20260807 20:00:16.789989 3203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:16.836912 3203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:16.837800 3203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:16.838099 3203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:16.839098 3203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:00:16.840660 3203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:00:16.840752 3203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:16.840850 3203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:00:16.840916 3203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:16.871130 3203 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.131:45973
I20260807 20:00:16.871181 3385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.131:45973 every 8 connection(s)
I20260807 20:00:16.872429 3203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/data/info.pb
I20260807 20:00:16.878769 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 3203
I20260807 20:00:16.878919 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal/instance
I20260807 20:00:16.879443 5910 external_mini_cluster.cc:1428] Setting key ea835197aa8e941faa8df4a1b70b2545
I20260807 20:00:16.885043 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.874898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:37853 (local address 127.5.197.190:45461)
0807 20:00:16.875083 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:16.875088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:16.876440 (+ 1352us) server_negotiation.cc:407] Connection header received
0807 20:00:16.878171 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:16.878175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:16.878245 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:16.878332 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:16.879394 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.880452 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.882639 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.883055 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.883154 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.884437 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:16.884442 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:16.884445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:16.884462 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:16.884492 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:16.884504 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:16.884577 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:16.884732 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 20:00:16.884805 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 20:00:16.885983 3392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.875393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45461 (local address 127.5.197.131:37853)
0807 20:00:16.876286 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:16.876327 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:16.877922 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:16.878521 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:16.878529 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:16.878609 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:16.879210 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.879231 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.880597 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.880603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.882498 (+ 1895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.882512 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.883277 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.883283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.883473 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.884113 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:00:16.884116 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:16.884154 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:00:16.884256 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:16.884577 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:16.884582 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:16.884587 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:00:16.884711 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 20:00:16.884978 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":295,"threads_started":1}
I20260807 20:00:16.887275 3386 heartbeater.cc:347] Connected to a master server at 127.5.197.190:45461
I20260807 20:00:16.887544 3386 heartbeater.cc:464] Registering TS with master...
I20260807 20:00:16.888294 3386 heartbeater.cc:511] Master 127.5.197.190:45461 requested a full tablet report, sending...
I20260807 20:00:16.889621 2764 ts_manager.cc:194] Registered new tserver with Master: 3fd9457fd7464da6b11b8365d593f378 (127.5.197.131:45973)
I20260807 20:00:16.890386 2764 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.197.131:37853
I20260807 20:00:16.894526 5910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:00:16.903514 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.898523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48312 (local address 127.5.197.190:45461)
0807 20:00:16.898677 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:16.898681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:16.899066 (+ 385us) server_negotiation.cc:407] Connection header received
0807 20:00:16.899203 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:16.899206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:16.899272 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:16.899359 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:16.899785 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.900443 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.901640 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.902042 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.902130 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.903013 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:16.903018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:16.903021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:16.903038 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:16.903066 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:16.903077 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:16.903141 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:16.903225 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 20:00:16.903291 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 20:00:16.906817 2764 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:00:16.913483 2764 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:00:16.947172 3408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.924798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.131:45973 (local address 127.0.0.1:42044)
0807 20:00:16.938060 (+ 13262us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:16.938082 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:16.938196 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:16.939145 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:16.939149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:16.939173 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:16.939583 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.939595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.941549 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.941554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.943936 (+ 2382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.943951 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.946260 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.946268 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.946503 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.946559 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 20:00:16.946670 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 20:00:16.946851 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13150,"thread_start_us":10141,"threads_started":1}
I20260807 20:00:16.947978 3411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.925416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42044 (local address 127.5.197.131:45973)
0807 20:00:16.926011 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:16.926020 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:16.938335 (+ 12315us) server_negotiation.cc:407] Connection header received
0807 20:00:16.938450 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:16.938457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:16.938666 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:16.938867 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:16.939826 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.941381 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.944174 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.945695 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.945824 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.946083 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:16.947447 (+ 1364us) server_negotiation.cc:299] Negotiation successful
0807 20:00:16.947612 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":258,"threads_started":1}
I20260807 20:00:16.949542 3409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.924643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:42663 (local address 127.0.0.1:34956)
0807 20:00:16.935425 (+ 10782us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:16.935482 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:16.935687 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:16.938685 (+ 2998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:16.938692 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:16.938722 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:16.939140 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.939152 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.944249 (+ 5097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.944253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.946383 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.946397 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.948752 (+ 2355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.948758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.948949 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.948982 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:00:16.949067 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 20:00:16.949195 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10458,"mutex_wait_us":61,"thread_start_us":14602,"threads_started":1}
I20260807 20:00:16.950500 3410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.924899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34956 (local address 127.5.197.130:42663)
0807 20:00:16.937760 (+ 12861us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:16.937770 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:16.937803 (+ 33us) server_negotiation.cc:407] Connection header received
0807 20:00:16.937910 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:16.937918 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:16.938194 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:16.938395 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:16.939594 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.941379 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.946599 (+ 5220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.948258 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.948381 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.948610 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:16.950002 (+ 1392us) server_negotiation.cc:299] Negotiation successful
0807 20:00:16.950170 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12695,"thread_start_us":12573,"threads_started":1}
I20260807 20:00:16.951851 3412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.927257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:44243 (local address 127.0.0.1:60066)
0807 20:00:16.943466 (+ 16209us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:16.943488 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:16.943600 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:16.944179 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:16.944183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:16.944209 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:16.944693 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.944707 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.947861 (+ 3154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.947865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.949794 (+ 1929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:16.949807 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.951127 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.951133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:16.951298 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.951329 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 20:00:16.951421 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 20:00:16.951533 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16097,"thread_start_us":15936,"threads_started":1}
I20260807 20:00:16.951982 3413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:16.927822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60066 (local address 127.5.197.129:44243)
0807 20:00:16.942812 (+ 14990us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:16.942821 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:16.943592 (+ 771us) server_negotiation.cc:407] Connection header received
0807 20:00:16.943777 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:16.943782 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:16.943969 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:16.944933 (+ 964us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:16.945152 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.947659 (+ 2507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.949975 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:16.950945 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:16.951073 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:16.951349 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:16.951460 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 20:00:16.951613 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14800,"thread_start_us":15168,"threads_started":1}
I20260807 20:00:16.952661 3291 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf7af8485cc4f838a4a222c987e90c0 (DEFAULT_TABLE table=test-table [id=a29627326d904ae7be1adbc2ecf29465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:16.954264 3291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf7af8485cc4f838a4a222c987e90c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:16.953974 3115 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf7af8485cc4f838a4a222c987e90c0 (DEFAULT_TABLE table=test-table [id=a29627326d904ae7be1adbc2ecf29465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:16.955309 3115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf7af8485cc4f838a4a222c987e90c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:16.954998 2941 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf7af8485cc4f838a4a222c987e90c0 (DEFAULT_TABLE table=test-table [id=a29627326d904ae7be1adbc2ecf29465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:00:16.956081 2941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf7af8485cc4f838a4a222c987e90c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:16.965952 3023 heartbeater.cc:503] Master 127.5.197.190:45461 was elected leader, sending a full tablet report...
I20260807 20:00:16.968411 3414 tablet_bootstrap.cc:492] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Bootstrap starting.
I20260807 20:00:16.971472 3414 tablet_bootstrap.cc:654] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:16.972662 3414 log.cc:824] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:16.974624 3415 tablet_bootstrap.cc:492] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Bootstrap starting.
I20260807 20:00:16.975641 3417 tablet_bootstrap.cc:492] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Bootstrap starting.
I20260807 20:00:16.978890 3415 tablet_bootstrap.cc:654] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:16.978969 3414 tablet_bootstrap.cc:492] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: No bootstrap required, opened a new log
I20260807 20:00:16.979127 3417 tablet_bootstrap.cc:654] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:16.979307 3414 ts_tablet_manager.cc:1397] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260807 20:00:16.979979 3415 log.cc:824] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:16.980366 3417 log.cc:824] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:16.982882 3417 tablet_bootstrap.cc:492] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: No bootstrap required, opened a new log
I20260807 20:00:16.982980 3415 tablet_bootstrap.cc:492] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: No bootstrap required, opened a new log
I20260807 20:00:16.983134 3417 ts_tablet_manager.cc:1397] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260807 20:00:16.983253 3415 ts_tablet_manager.cc:1397] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 20:00:16.989452 3414 raft_consensus.cc:348] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:16.989967 3414 raft_consensus.cc:374] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:16.990082 3414 raft_consensus.cc:729] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a5423fd531e4949ad952c11086fa661, State: Initialized, Role: FOLLOWER
I20260807 20:00:16.990409 3417 raft_consensus.cc:348] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:16.990826 3417 raft_consensus.cc:374] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:16.990957 3417 raft_consensus.cc:729] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369b250439114279877a55d558b08d83, State: Initialized, Role: FOLLOWER
I20260807 20:00:16.990790 3414 consensus_queue.cc:260] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:16.991495 3417 consensus_queue.cc:260] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:16.992605 3198 heartbeater.cc:503] Master 127.5.197.190:45461 was elected leader, sending a full tablet report...
I20260807 20:00:16.993284 3417 ts_tablet_manager.cc:1428] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260807 20:00:16.993300 3415 raft_consensus.cc:348] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:16.993769 3415 raft_consensus.cc:374] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:16.993917 3415 raft_consensus.cc:729] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd9457fd7464da6b11b8365d593f378, State: Initialized, Role: FOLLOWER
I20260807 20:00:16.994570 3414 ts_tablet_manager.cc:1428] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Time spent starting tablet: real 0.015s user 0.008s sys 0.005s
I20260807 20:00:16.994709 3415 consensus_queue.cc:260] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:16.995841 3386 heartbeater.cc:503] Master 127.5.197.190:45461 was elected leader, sending a full tablet report...
I20260807 20:00:16.996402 3415 ts_tablet_manager.cc:1428] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
I20260807 20:00:17.064996 3425 raft_consensus.cc:482] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:00:17.065331 3425 raft_consensus.cc:504] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:17.067055 3425 leader_election.cc:288] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369b250439114279877a55d558b08d83 (127.5.197.130:42663), 3a5423fd531e4949ad952c11086fa661 (127.5.197.129:44243)
I20260807 20:00:17.072685 3410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.067609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:49591 (local address 127.5.197.130:42663)
0807 20:00:17.067863 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:17.067869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:17.067966 (+ 97us) server_negotiation.cc:407] Connection header received
0807 20:00:17.068176 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:17.068180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:17.068262 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:17.068337 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:17.068735 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.069416 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.071076 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.071862 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.072005 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.072076 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:17.072308 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 20:00:17.072426 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260807 20:00:17.072729 3392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.067529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.130:42663 (local address 127.5.197.131:49591)
0807 20:00:17.067867 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:17.067886 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:17.068026 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:17.068382 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:17.068387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:17.068414 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:17.068601 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:17.068609 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.069559 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.069563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:17.070913 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:17.070925 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.072006 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.072012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:17.072156 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.072179 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 20:00:17.072256 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 20:00:17.072387 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":1,"spinlock_wait_cycles":4480}
I20260807 20:00:17.073203 3413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.067721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.197.131:55307 (local address 127.5.197.129:44243)
0807 20:00:17.067910 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:17.067915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:17.068428 (+ 513us) server_negotiation.cc:407] Connection header received
0807 20:00:17.068589 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:17.068593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:17.068662 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:17.068734 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:00:17.069242 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.069931 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.071570 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.072375 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.072518 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.072583 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:17.072900 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 20:00:17.073025 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 20:00:17.073680 3427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.067579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.129:44243 (local address 127.5.197.131:55307)
0807 20:00:17.068321 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:17.068335 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:17.068458 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:17.068768 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:17.068771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:17.068794 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:00:17.069084 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:17.069093 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.070078 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.070082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:17.071395 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:17.071406 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.072534 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.072540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:17.072708 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.072732 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 20:00:17.073364 (+ 632us) client_negotiation.cc:240] Negotiation successful
0807 20:00:17.073474 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":445,"threads_started":1}
I20260807 20:00:17.073673 3138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf7af8485cc4f838a4a222c987e90c0" candidate_uuid: "3fd9457fd7464da6b11b8365d593f378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369b250439114279877a55d558b08d83" is_pre_election: true
I20260807 20:00:17.074234 3138 raft_consensus.cc:2454] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd9457fd7464da6b11b8365d593f378 in term 0.
I20260807 20:00:17.074749 2968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf7af8485cc4f838a4a222c987e90c0" candidate_uuid: "3fd9457fd7464da6b11b8365d593f378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a5423fd531e4949ad952c11086fa661" is_pre_election: true
I20260807 20:00:17.075199 3228 leader_election.cc:302] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369b250439114279877a55d558b08d83, 3fd9457fd7464da6b11b8365d593f378; no voters:
I20260807 20:00:17.075337 2968 raft_consensus.cc:2454] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd9457fd7464da6b11b8365d593f378 in term 0.
I20260807 20:00:17.075599 3425 raft_consensus.cc:2781] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:00:17.075778 3425 raft_consensus.cc:482] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:00:17.075888 3425 raft_consensus.cc:3037] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:17.079066 3425 raft_consensus.cc:504] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:17.079715 3425 leader_election.cc:288] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [CANDIDATE]: Term 1 election: Requested vote from peers 369b250439114279877a55d558b08d83 (127.5.197.130:42663), 3a5423fd531e4949ad952c11086fa661 (127.5.197.129:44243)
I20260807 20:00:17.080219 3138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf7af8485cc4f838a4a222c987e90c0" candidate_uuid: "3fd9457fd7464da6b11b8365d593f378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369b250439114279877a55d558b08d83"
I20260807 20:00:17.080224 2968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf7af8485cc4f838a4a222c987e90c0" candidate_uuid: "3fd9457fd7464da6b11b8365d593f378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a5423fd531e4949ad952c11086fa661"
I20260807 20:00:17.080427 3138 raft_consensus.cc:3037] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:17.080442 2968 raft_consensus.cc:3037] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:17.082820 2968 raft_consensus.cc:2454] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fd9457fd7464da6b11b8365d593f378 in term 1.
I20260807 20:00:17.082863 3138 raft_consensus.cc:2454] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fd9457fd7464da6b11b8365d593f378 in term 1.
I20260807 20:00:17.083242 3228 leader_election.cc:302] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 369b250439114279877a55d558b08d83, 3a5423fd531e4949ad952c11086fa661, 3fd9457fd7464da6b11b8365d593f378; no voters:
I20260807 20:00:17.083550 3425 raft_consensus.cc:2781] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:17.083971 3425 raft_consensus.cc:686] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 1 LEADER]: Becoming Leader. State: Replica: 3fd9457fd7464da6b11b8365d593f378, State: Running, Role: LEADER
I20260807 20:00:17.084479 3425 consensus_queue.cc:237] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } }
I20260807 20:00:17.089123 2763 catalog_manager.cc:5495] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fd9457fd7464da6b11b8365d593f378 (127.5.197.131). New cstate: current_term: 1 leader_uuid: "3fd9457fd7464da6b11b8365d593f378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fd9457fd7464da6b11b8365d593f378" member_type: VOTER last_known_addr { host: "127.5.197.131" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 } health_report { overall_health: UNKNOWN } } }
I20260807 20:00:17.123814 3411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.118406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.5.197.131:45973)
0807 20:00:17.118607 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:17.118613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:17.118746 (+ 133us) server_negotiation.cc:407] Connection header received
0807 20:00:17.118976 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:17.118980 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:17.119055 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:17.119184 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:00:17.119549 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.120326 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.121701 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.122106 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.122229 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.122715 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:00:17.123217 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:00:17.123382 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:17.123435 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 20:00:17.123510 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 20:00:17.123965 3390 tablet.cc:2369] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:17.131616 2968 raft_consensus.cc:1261] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 1 FOLLOWER]: Refusing update from remote peer 3fd9457fd7464da6b11b8365d593f378: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:17.131705 3138 raft_consensus.cc:1261] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 1 FOLLOWER]: Refusing update from remote peer 3fd9457fd7464da6b11b8365d593f378: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:17.132624 3428 consensus_queue.cc:1035] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369b250439114279877a55d558b08d83" member_type: VOTER last_known_addr { host: "127.5.197.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:17.133018 3425 consensus_queue.cc:1035] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a5423fd531e4949ad952c11086fa661" member_type: VOTER last_known_addr { host: "127.5.197.129" port: 44243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 20:00:17.143015 3199 tablet.cc:2369] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:17.144136 3431 mvcc.cc:205] Tried to move back new op lower bound from 7316000018961735680 to 7316000018781974528. Current Snapshot: MvccSnapshot[applied={T|T < 7316000018961735680}]
I20260807 20:00:17.145845 3433 mvcc.cc:205] Tried to move back new op lower bound from 7316000018961735680 to 7316000018781974528. Current Snapshot: MvccSnapshot[applied={T|T < 7316000018961735680}]
I20260807 20:00:17.157992 2764 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:17.158303 2764 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:00:17.161798 2764 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb55d55e8918491e9022edeb8dfcda63: Sending DeleteTablet for 3 replicas of tablet 7cf7af8485cc4f838a4a222c987e90c0
I20260807 20:00:17.162813 3115 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf7af8485cc4f838a4a222c987e90c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:17 UTC) from {username='slave'} at 127.0.0.1:34956
I20260807 20:00:17.162923 3291 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf7af8485cc4f838a4a222c987e90c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:17 UTC) from {username='slave'} at 127.0.0.1:42044
I20260807 20:00:17.162923 2941 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf7af8485cc4f838a4a222c987e90c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:00:17 UTC) from {username='slave'} at 127.0.0.1:60066
I20260807 20:00:17.163800 3444 tablet_replica.cc:330] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: stopping tablet replica
I20260807 20:00:17.164278 3444 raft_consensus.cc:2229] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:17.164829 3444 raft_consensus.cc:2258] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:17.167616 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 2841
I20260807 20:00:17.176385 3444 ts_tablet_manager.cc:1905] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:17.176895 3446 tablet_replica.cc:330] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: stopping tablet replica
I20260807 20:00:17.177560 3446 raft_consensus.cc:2229] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:00:17.178236 3446 raft_consensus.cc:2258] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:17.180809 3446 ts_tablet_manager.cc:1905] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:17.181389 3448 tablet_replica.cc:330] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: stopping tablet replica
I20260807 20:00:17.181747 3448 raft_consensus.cc:2229] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:00:17.182318 3448 raft_consensus.cc:2258] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:00:17.187107 3446 ts_tablet_manager.cc:1918] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:17.187345 3446 log.cc:1196] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-0/wal/wals/7cf7af8485cc4f838a4a222c987e90c0
I20260807 20:00:17.188077 3446 ts_tablet_manager.cc:1939] T 7cf7af8485cc4f838a4a222c987e90c0 P 3a5423fd531e4949ad952c11086fa661: Deleting consensus metadata
I20260807 20:00:17.189231 3448 ts_tablet_manager.cc:1905] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:00:17.190238 2746 catalog_manager.cc:4841] TS 3a5423fd531e4949ad952c11086fa661 (127.5.197.129:44243): tablet 7cf7af8485cc4f838a4a222c987e90c0 (table test-table [id=a29627326d904ae7be1adbc2ecf29465]) successfully deleted
I20260807 20:00:17.191538 3444 ts_tablet_manager.cc:1918] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:17.191823 3444 log.cc:1196] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-1/wal/wals/7cf7af8485cc4f838a4a222c987e90c0
I20260807 20:00:17.192422 3444 ts_tablet_manager.cc:1939] T 7cf7af8485cc4f838a4a222c987e90c0 P 369b250439114279877a55d558b08d83: Deleting consensus metadata
I20260807 20:00:17.194252 2748 catalog_manager.cc:4841] TS 369b250439114279877a55d558b08d83 (127.5.197.130:42663): tablet 7cf7af8485cc4f838a4a222c987e90c0 (table test-table [id=a29627326d904ae7be1adbc2ecf29465]) successfully deleted
I20260807 20:00:17.195919 3413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.169997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60074 (local address 127.5.197.129:44243)
0807 20:00:17.170183 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:17.170190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:17.187146 (+ 16956us) server_negotiation.cc:407] Connection header received
0807 20:00:17.187645 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:17.187652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:17.187836 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:17.187917 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:17.188632 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.189856 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.191843 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.192464 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.192559 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.194222 (+ 1663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:17.194234 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:17.194252 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:17.195040 (+ 788us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:17.195099 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:17.195122 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:17.195235 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:17.195401 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 20:00:17.195512 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 20:00:17.196511 3448 ts_tablet_manager.cc:1918] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:00:17.196710 3448 log.cc:1196] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Deleting WAL directory at /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132491354022-5910-0/minicluster-data/ts-2/wal/wals/7cf7af8485cc4f838a4a222c987e90c0
I20260807 20:00:17.196900 3017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:17.197302 3448 ts_tablet_manager.cc:1939] T 7cf7af8485cc4f838a4a222c987e90c0 P 3fd9457fd7464da6b11b8365d593f378: Deleting consensus metadata
I20260807 20:00:17.200031 2747 catalog_manager.cc:4841] TS 3fd9457fd7464da6b11b8365d593f378 (127.5.197.131:45973): tablet 7cf7af8485cc4f838a4a222c987e90c0 (table test-table [id=a29627326d904ae7be1adbc2ecf29465]) successfully deleted
I20260807 20:00:17.292822 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 2841
I20260807 20:00:17.316488 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3029
I20260807 20:00:17.327579 3410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.317393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34972 (local address 127.5.197.130:42663)
0807 20:00:17.317593 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:17.317600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:17.317641 (+ 41us) server_negotiation.cc:407] Connection header received
0807 20:00:17.317711 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:17.317716 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:17.317827 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:17.317932 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:17.318257 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.319425 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.320665 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.321296 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.321431 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.325921 (+ 4490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:17.325933 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:17.325953 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:17.326759 (+ 806us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:17.326823 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:17.326850 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:17.326957 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:17.327088 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 20:00:17.327200 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 20:00:17.328359 3190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:17.424017 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 3029
I20260807 20:00:17.446763 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3203
I20260807 20:00:17.454346 3411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:17.447645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42064 (local address 127.5.197.131:45973)
0807 20:00:17.447958 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:17.447963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:17.448051 (+ 88us) server_negotiation.cc:407] Connection header received
0807 20:00:17.448277 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:17.448284 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:17.448368 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:17.448465 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:17.448945 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.449803 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.451179 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:17.451616 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:17.451766 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:17.452780 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:17.452789 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:17.452806 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:17.453562 (+ 756us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:17.453616 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:17.453640 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:17.453749 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:17.453890 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 20:00:17.453991 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 20:00:17.455106 3378 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:17.576965 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 3203
I20260807 20:00:17.603938 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 2724
I20260807 20:00:17.605082 2807 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:17.712879 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 2724
2026-08-07T20:00:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2846 ms)
[----------] 6 tests from EncryptionPolicyTest (22139 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:17 dist-test-slave-6bbx krb5kdc[3457](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:17 dist-test-slave-6bbx krb5kdc[3457](info): set up 2 sockets
Aug 07 20:00:17 dist-test-slave-6bbx krb5kdc[3457](info): commencing operation
krb5kdc: starting...
W20260807 20:00:18.934159 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:19 dist-test-slave-6bbx krb5kdc[3457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:19.250944 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40051
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40051
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:19.592384 3474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:19.592738 3474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:19.592891 3474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:19.600142 3474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:19.600260 3474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:19.600346 3474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:19.600436 3474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:19.600495 3474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:19.610301 3474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40051
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:19.611599 3474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:19.612947 3474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:19.624166 3481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:19.624199 3482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:19.624228 3488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:19.625238 3474 server_base.cc:1034] running on GCE node
I20260807 20:00:19.625982 3474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:19.627300 3474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:19.628509 3474 hybrid_clock.cc:648] HybridClock initialized: now 1786132819628462 us; error 34 us; skew 500 ppm
I20260807 20:00:19.628876 3474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:19 dist-test-slave-6bbx krb5kdc[3457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132819, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:19.632016 3474 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:19.633460 3474 webserver.cc:460] Webserver started at http://127.0.0.1:42931/ using document root <none> and password file <none>
I20260807 20:00:19.634127 3474 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:19.634243 3474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:19.634528 3474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:19.637445 3474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "0e8adab627a74612a8d8ae75af5094e2"
format_stamp: "Formatted at 2026-08-07 20:00:19 on dist-test-slave-6bbx"
server_key: "bc271cc98f10db5ce179ccdce23767cc"
server_key_iv: "49731395bf2eb16b9ccd6db98bdb8049"
server_key_version: "encryptionkey@0"
I20260807 20:00:19.638166 3474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "0e8adab627a74612a8d8ae75af5094e2"
format_stamp: "Formatted at 2026-08-07 20:00:19 on dist-test-slave-6bbx"
server_key: "bc271cc98f10db5ce179ccdce23767cc"
server_key_iv: "49731395bf2eb16b9ccd6db98bdb8049"
server_key_version: "encryptionkey@0"
I20260807 20:00:19.643096 3474 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 20:00:19.646407 3498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:19.647609 3474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:19.647812 3474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "0e8adab627a74612a8d8ae75af5094e2"
format_stamp: "Formatted at 2026-08-07 20:00:19 on dist-test-slave-6bbx"
server_key: "bc271cc98f10db5ce179ccdce23767cc"
server_key_iv: "49731395bf2eb16b9ccd6db98bdb8049"
server_key_version: "encryptionkey@0"
I20260807 20:00:19.647984 3474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:19.678630 3474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:19.682775 3474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:19.683044 3474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:19.700526 3474 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40051
I20260807 20:00:19.700562 3568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40051 every 8 connection(s)
I20260807 20:00:19.701817 3474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:19.704550 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 3474
I20260807 20:00:19.704763 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:19.705610 5910 external_mini_cluster.cc:1428] Setting key 960d36e3a53af176cb53e6f6c81d4de6
I20260807 20:00:19.705961 3569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:19.717868 3569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2: Bootstrap starting.
Aug 07 20:00:19 dist-test-slave-6bbx krb5kdc[3457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:00:19.721028 3569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:19.722072 3569 log.cc:824] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:19.724797 3569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2: No bootstrap required, opened a new log
I20260807 20:00:19.727324 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:19.707535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42279 (local address 127.0.0.1:40051)
0807 20:00:19.708300 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:19.708313 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:19.708352 (+ 39us) server_negotiation.cc:407] Connection header received
0807 20:00:19.710411 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:19.710434 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:19.710814 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:19.711186 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:19.712677 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:19.713958 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:19.715243 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:19.715996 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:19.716173 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:19.720279 (+ 4106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:19.720287 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:19.720300 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:19.720344 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:19.723264 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:19.724096 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:19.724102 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:19.724108 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:19.724269 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:19.724722 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:19.724726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:19.724728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:19.725267 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:19.725591 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:19.726044 (+ 453us) server_negotiation.cc:299] Negotiation successful
0807 20:00:19.726356 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":329,"threads_started":1}
I20260807 20:00:19.731110 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:19.732641 3569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e8adab627a74612a8d8ae75af5094e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40051 } }
I20260807 20:00:19.732975 3569 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:19.733076 3569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e8adab627a74612a8d8ae75af5094e2, State: Initialized, Role: FOLLOWER
I20260807 20:00:19.733613 3569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e8adab627a74612a8d8ae75af5094e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40051 } }
I20260807 20:00:19.733897 3569 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:19.734041 3569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:19.734212 3569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:19.736523 3569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e8adab627a74612a8d8ae75af5094e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40051 } }
I20260807 20:00:19.737047 3569 leader_election.cc:302] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e8adab627a74612a8d8ae75af5094e2; no voters:
I20260807 20:00:19.737646 3569 leader_election.cc:288] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:19.737805 3583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:19.738456 3583 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [term 1 LEADER]: Becoming Leader. State: Replica: 0e8adab627a74612a8d8ae75af5094e2, State: Running, Role: LEADER
I20260807 20:00:19.739073 3583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e8adab627a74612a8d8ae75af5094e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40051 } }
I20260807 20:00:19.741540 3569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:19.741787 3585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e8adab627a74612a8d8ae75af5094e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e8adab627a74612a8d8ae75af5094e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40051 } } }
I20260807 20:00:19.742187 3585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:19.742748 3584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e8adab627a74612a8d8ae75af5094e2. Latest consensus state: current_term: 1 leader_uuid: "0e8adab627a74612a8d8ae75af5094e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e8adab627a74612a8d8ae75af5094e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40051 } } }
I20260807 20:00:19.743034 3584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:19.753307 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:19.735767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60909 (local address 127.0.0.1:40051)
0807 20:00:19.735934 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:19.735940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:19.736396 (+ 456us) server_negotiation.cc:407] Connection header received
0807 20:00:19.736523 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:19.736529 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:19.736604 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:19.736718 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:19.738374 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:19.739498 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:19.741268 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:19.741995 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:19.742099 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:19.745543 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:19.745551 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:19.745556 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:19.745595 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:19.749355 (+ 3760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:19.750400 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:19.750406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:19.750410 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:19.750571 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:19.751203 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:19.751208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:19.751212 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:19.751644 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:19.751984 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:19.752707 (+ 723us) server_negotiation.cc:299] Negotiation successful
0807 20:00:19.752913 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 20:00:19.758113 3587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:19.763396 3587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:19.772118 3587 catalog_manager.cc:1347] Generated new cluster ID: 010b328a0b2945989ef473b040a2201c
I20260807 20:00:19.772260 3587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:19.785367 3587 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:19.786640 3587 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:19.793156 3587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e8adab627a74612a8d8ae75af5094e2: Generated new TSK 0
I20260807 20:00:19.793830 3587 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:19.800794 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3474
I20260807 20:00:19.802264 3560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:19.890388 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 3474
W20260807 20:00:19.910993 3455 connection.cc:535] client connection to 127.0.0.1:40051 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40051): Connection reset by peer (error 104)
2026-08-07T20:00:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2168 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:20 dist-test-slave-6bbx krb5kdc[3610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:20 dist-test-slave-6bbx krb5kdc[3610](info): set up 2 sockets
Aug 07 20:00:20 dist-test-slave-6bbx krb5kdc[3610](info): commencing operation
krb5kdc: starting...
W20260807 20:00:21.102281 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.001s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:21 dist-test-slave-6bbx krb5kdc[3610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:21.402961 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44629
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:21.742679 3627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:21.742949 3627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:21.743046 3627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:21.750144 3627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:21.750262 3627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:21.750316 3627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:21.750376 3627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:21.750419 3627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:21.759985 3627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44629
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:21.761188 3627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:21.762436 3627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:21.773523 3636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:21.773566 3637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:21.773618 3640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:21.774359 3627 server_base.cc:1034] running on GCE node
I20260807 20:00:21.775079 3627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:21.776446 3627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:21.777644 3627 hybrid_clock.cc:648] HybridClock initialized: now 1786132821777604 us; error 30 us; skew 500 ppm
I20260807 20:00:21.777987 3627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:21 dist-test-slave-6bbx krb5kdc[3610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132821, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:21.780953 3627 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:21.782389 3627 webserver.cc:460] Webserver started at http://127.0.0.1:36865/ using document root <none> and password file <none>
I20260807 20:00:21.783051 3627 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:21.783169 3627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:21.783455 3627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:21.786389 3627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "c23d2fc0e47441a3898d123ede15689b"
format_stamp: "Formatted at 2026-08-07 20:00:21 on dist-test-slave-6bbx"
server_key: "04df3a44b4faf7c408a36b063a6329f4"
server_key_iv: "87986dbfca6a014526c21c666024ad49"
server_key_version: "encryptionkey@0"
I20260807 20:00:21.787132 3627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "c23d2fc0e47441a3898d123ede15689b"
format_stamp: "Formatted at 2026-08-07 20:00:21 on dist-test-slave-6bbx"
server_key: "04df3a44b4faf7c408a36b063a6329f4"
server_key_iv: "87986dbfca6a014526c21c666024ad49"
server_key_version: "encryptionkey@0"
I20260807 20:00:21.792147 3627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 20:00:21.795534 3647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:21.796819 3627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:21.796979 3627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "c23d2fc0e47441a3898d123ede15689b"
format_stamp: "Formatted at 2026-08-07 20:00:21 on dist-test-slave-6bbx"
server_key: "04df3a44b4faf7c408a36b063a6329f4"
server_key_iv: "87986dbfca6a014526c21c666024ad49"
server_key_version: "encryptionkey@0"
I20260807 20:00:21.797156 3627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:21.823454 3627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:21.827280 3627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:21.827539 3627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:21.845033 3627 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44629
I20260807 20:00:21.845067 3711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44629 every 8 connection(s)
I20260807 20:00:21.846349 3627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:21.849958 3712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:21.851164 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 3627
I20260807 20:00:21.851362 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:21.851838 5910 external_mini_cluster.cc:1428] Setting key 2ef5106e9ed0ddee2289412c104903de
I20260807 20:00:21.863900 3712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b: Bootstrap starting.
I20260807 20:00:21.865869 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:21.853616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60725 (local address 127.0.0.1:44629)
0807 20:00:21.854420 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:21.854435 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:21.854484 (+ 49us) server_negotiation.cc:407] Connection header received
0807 20:00:21.856258 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:21.856288 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:21.856778 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:21.857206 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:21.857709 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:21.859531 (+ 1822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:21.860860 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:21.861896 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:21.862059 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:21.863153 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:21.863163 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:21.863180 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:21.863887 (+ 707us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:21.863996 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:21.864029 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:21.864179 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:21.864462 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 20:00:21.864631 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":329,"threads_started":1}
I20260807 20:00:21.867447 3712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:21.868561 3712 log.cc:824] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:21.869576 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:21.871305 3712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b: No bootstrap required, opened a new log
I20260807 20:00:21.880496 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:21.873987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40469 (local address 127.0.0.1:44629)
0807 20:00:21.874120 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:21.874124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:21.874466 (+ 342us) server_negotiation.cc:407] Connection header received
0807 20:00:21.874653 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:21.874660 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:21.874718 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:21.874793 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:21.875347 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:21.876161 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:21.878080 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:21.878559 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:21.878660 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:21.879803 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:21.879809 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:21.879814 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:21.879829 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:21.879877 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:21.879892 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:21.879970 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:21.880149 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 20:00:21.880187 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 20:00:21.880501 3712 raft_consensus.cc:348] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c23d2fc0e47441a3898d123ede15689b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44629 } }
I20260807 20:00:21.880995 3712 raft_consensus.cc:374] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:21.881114 3712 raft_consensus.cc:729] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c23d2fc0e47441a3898d123ede15689b, State: Initialized, Role: FOLLOWER
I20260807 20:00:21.881788 3712 consensus_queue.cc:260] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c23d2fc0e47441a3898d123ede15689b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44629 } }
I20260807 20:00:21.882020 3712 raft_consensus.cc:388] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:21.882157 3712 raft_consensus.cc:482] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:21.882308 3712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:21.884438 3712 raft_consensus.cc:504] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c23d2fc0e47441a3898d123ede15689b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44629 } }
I20260807 20:00:21.884888 3712 leader_election.cc:302] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c23d2fc0e47441a3898d123ede15689b; no voters:
I20260807 20:00:21.885399 3712 leader_election.cc:288] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:21.885492 3724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:21.886174 3724 raft_consensus.cc:686] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [term 1 LEADER]: Becoming Leader. State: Replica: c23d2fc0e47441a3898d123ede15689b, State: Running, Role: LEADER
I20260807 20:00:21.886780 3724 consensus_queue.cc:237] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c23d2fc0e47441a3898d123ede15689b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44629 } }
I20260807 20:00:21.887517 3712 sys_catalog.cc:564] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:21.889607 3725 sys_catalog.cc:455] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c23d2fc0e47441a3898d123ede15689b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c23d2fc0e47441a3898d123ede15689b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44629 } } }
I20260807 20:00:21.889875 3726 sys_catalog.cc:455] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c23d2fc0e47441a3898d123ede15689b. Latest consensus state: current_term: 1 leader_uuid: "c23d2fc0e47441a3898d123ede15689b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c23d2fc0e47441a3898d123ede15689b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44629 } } }
I20260807 20:00:21.890071 3725 sys_catalog.cc:458] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:21.890152 3726 sys_catalog.cc:458] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:21.891848 3737 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:21.896126 3737 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:21.904039 3737 catalog_manager.cc:1347] Generated new cluster ID: 48b3ded518034f0fa24dade691c72150
I20260807 20:00:21.904140 3737 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:21.915441 3737 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:21.916692 3737 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:21.924763 3737 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c23d2fc0e47441a3898d123ede15689b: Generated new TSK 0
I20260807 20:00:21.925447 3737 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:21.931910 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3627
W20260807 20:00:21.932943 3706 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60725
W20260807 20:00:21.933624 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3627: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:21.933781 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 3627
W20260807 20:00:21.951880 3607 connection.cc:535] client connection to 127.0.0.1:44629 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44629): Connection reset by peer (error 104)
2026-08-07T20:00:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2040 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:22 dist-test-slave-6bbx krb5kdc[3754](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:22 dist-test-slave-6bbx krb5kdc[3754](info): set up 2 sockets
Aug 07 20:00:22 dist-test-slave-6bbx krb5kdc[3754](info): commencing operation
krb5kdc: starting...
W20260807 20:00:23.139318 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.005s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:23 dist-test-slave-6bbx krb5kdc[3754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:23.459955 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42605
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:23.795594 3775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:23.795917 3775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:23.796058 3775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:23.803013 3775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:23.803123 3775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:23.803201 3775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:23.803285 3775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:23.803355 3775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:23.812768 3775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42605
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:23.813990 3775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:23.815253 3775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:23.826581 3783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:23.826622 3786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:23.826642 3784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:23.827404 3775 server_base.cc:1034] running on GCE node
I20260807 20:00:23.828200 3775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:23.829569 3775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:23.830775 3775 hybrid_clock.cc:648] HybridClock initialized: now 1786132823830728 us; error 35 us; skew 500 ppm
I20260807 20:00:23.831101 3775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:23 dist-test-slave-6bbx krb5kdc[3754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132823, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:23.836601 3775 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:23.837980 3775 webserver.cc:460] Webserver started at http://127.0.0.1:41163/ using document root <none> and password file <none>
I20260807 20:00:23.838629 3775 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:23.838762 3775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:23.839052 3775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:23.842000 3775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "4bea9063fb764ff9a648846ad5d2aa67"
format_stamp: "Formatted at 2026-08-07 20:00:23 on dist-test-slave-6bbx"
server_key: "4b384e84855adfa36f9e0875a731fb1c"
server_key_iv: "13a94a6f5e660a97617f9572cc8fa2e0"
server_key_version: "encryptionkey@0"
I20260807 20:00:23.842756 3775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "4bea9063fb764ff9a648846ad5d2aa67"
format_stamp: "Formatted at 2026-08-07 20:00:23 on dist-test-slave-6bbx"
server_key: "4b384e84855adfa36f9e0875a731fb1c"
server_key_iv: "13a94a6f5e660a97617f9572cc8fa2e0"
server_key_version: "encryptionkey@0"
I20260807 20:00:23.847625 3775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260807 20:00:23.850941 3798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:23.852181 3775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 20:00:23.852368 3775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "4bea9063fb764ff9a648846ad5d2aa67"
format_stamp: "Formatted at 2026-08-07 20:00:23 on dist-test-slave-6bbx"
server_key: "4b384e84855adfa36f9e0875a731fb1c"
server_key_iv: "13a94a6f5e660a97617f9572cc8fa2e0"
server_key_version: "encryptionkey@0"
I20260807 20:00:23.852548 3775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:23.857846 3775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:23.862072 3775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:23.862366 3775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:23.878805 3775 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42605
I20260807 20:00:23.878870 3872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42605 every 8 connection(s)
I20260807 20:00:23.880192 3775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:23.883770 3873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:23.890501 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 3775
I20260807 20:00:23.890683 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:23.891215 5910 external_mini_cluster.cc:1428] Setting key 611264aeaf70f58945b4225f8d1bd136
I20260807 20:00:23.894457 3873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67: Bootstrap starting.
I20260807 20:00:23.897598 3873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:23.898614 3873 log.cc:824] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:23.898761 3876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:23.893003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47149 (local address 127.0.0.1:42605)
0807 20:00:23.893811 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:23.893822 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:23.893863 (+ 41us) server_negotiation.cc:407] Connection header received
0807 20:00:23.895558 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:23.895580 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:23.895966 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:23.896316 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:23.897268 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:23.897274 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:23.897286 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:23.897300 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:23.897358 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:23.897381 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:23.897545 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:23.897687 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 20:00:23.897886 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":348,"threads_started":1}
I20260807 20:00:23.901465 3873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67: No bootstrap required, opened a new log
I20260807 20:00:23.902246 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:23.908812 3876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:23.906382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53775 (local address 127.0.0.1:42605)
0807 20:00:23.906562 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:23.906567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:23.906886 (+ 319us) server_negotiation.cc:407] Connection header received
0807 20:00:23.907038 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:23.907042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:23.907084 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:23.907162 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:23.908195 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:23.908207 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:23.908210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:23.908225 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:23.908264 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:23.908279 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:23.908386 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:23.908506 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 20:00:23.908549 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 20:00:23.909287 3873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bea9063fb764ff9a648846ad5d2aa67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42605 } }
I20260807 20:00:23.909623 3873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:23.909739 3873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bea9063fb764ff9a648846ad5d2aa67, State: Initialized, Role: FOLLOWER
I20260807 20:00:23.910291 3873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bea9063fb764ff9a648846ad5d2aa67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42605 } }
I20260807 20:00:23.910518 3873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:23.910643 3873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:23.910816 3873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:23.913013 3873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bea9063fb764ff9a648846ad5d2aa67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42605 } }
I20260807 20:00:23.913512 3873 leader_election.cc:302] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bea9063fb764ff9a648846ad5d2aa67; no voters:
I20260807 20:00:23.914074 3873 leader_election.cc:288] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:23.914194 3887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:23.914840 3887 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [term 1 LEADER]: Becoming Leader. State: Replica: 4bea9063fb764ff9a648846ad5d2aa67, State: Running, Role: LEADER
I20260807 20:00:23.915344 3887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bea9063fb764ff9a648846ad5d2aa67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42605 } }
I20260807 20:00:23.916028 3873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:23.918155 3888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bea9063fb764ff9a648846ad5d2aa67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bea9063fb764ff9a648846ad5d2aa67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42605 } } }
I20260807 20:00:23.918584 3888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:23.918129 3889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bea9063fb764ff9a648846ad5d2aa67. Latest consensus state: current_term: 1 leader_uuid: "4bea9063fb764ff9a648846ad5d2aa67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bea9063fb764ff9a648846ad5d2aa67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42605 } } }
I20260807 20:00:23.919708 3889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:23.923079 3894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:23.927043 3894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:23.934679 3894 catalog_manager.cc:1347] Generated new cluster ID: 1a66346f5e03464693b2b4b82a012c9e
I20260807 20:00:23.934775 3894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:23.944753 3894 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:23.945170 3894 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:23.953346 3894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bea9063fb764ff9a648846ad5d2aa67: Generated new TSK 0
I20260807 20:00:23.954262 3894 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:23.968600 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3775
W20260807 20:00:23.969784 3867 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47149
W20260807 20:00:23.970489 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3775: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:23.970641 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 3775
2026-08-07T20:00:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2039 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:24 dist-test-slave-6bbx krb5kdc[3916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:24 dist-test-slave-6bbx krb5kdc[3916](info): set up 2 sockets
Aug 07 20:00:24 dist-test-slave-6bbx krb5kdc[3916](info): commencing operation
krb5kdc: starting...
W20260807 20:00:25.179752 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:25 dist-test-slave-6bbx krb5kdc[3916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:25.488684 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39723
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:25.822100 3934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:25.822417 3934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:25.822551 3934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:25.829761 3934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:25.829870 3934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:25.829948 3934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:25.830024 3934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:25.830080 3934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:25.839723 3934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:25.840988 3934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:25.842270 3934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:25.853883 3943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:25.853842 3945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:25.853933 3942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:25.854915 3934 server_base.cc:1034] running on GCE node
I20260807 20:00:25.855724 3934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:25.857061 3934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:25.858290 3934 hybrid_clock.cc:648] HybridClock initialized: now 1786132825858241 us; error 37 us; skew 500 ppm
I20260807 20:00:25.858634 3934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:25 dist-test-slave-6bbx krb5kdc[3916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132825, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:25.861743 3934 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:25.863123 3934 webserver.cc:460] Webserver started at http://127.0.0.1:39069/ using document root <none> and password file <none>
I20260807 20:00:25.863895 3934 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:25.864022 3934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:25.864321 3934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:25.867244 3934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "10e5eb85479848db9f349bf7327fb578"
format_stamp: "Formatted at 2026-08-07 20:00:25 on dist-test-slave-6bbx"
server_key: "5caa3c7322b7376d9b74fc420219a478"
server_key_iv: "d50743589b58f2ffeac70cfeae2a0cfd"
server_key_version: "encryptionkey@0"
I20260807 20:00:25.868000 3934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "10e5eb85479848db9f349bf7327fb578"
format_stamp: "Formatted at 2026-08-07 20:00:25 on dist-test-slave-6bbx"
server_key: "5caa3c7322b7376d9b74fc420219a478"
server_key_iv: "d50743589b58f2ffeac70cfeae2a0cfd"
server_key_version: "encryptionkey@0"
I20260807 20:00:25.872936 3934 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 20:00:25.876209 3955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:25.877498 3934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:00:25.877661 3934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "10e5eb85479848db9f349bf7327fb578"
format_stamp: "Formatted at 2026-08-07 20:00:25 on dist-test-slave-6bbx"
server_key: "5caa3c7322b7376d9b74fc420219a478"
server_key_iv: "d50743589b58f2ffeac70cfeae2a0cfd"
server_key_version: "encryptionkey@0"
I20260807 20:00:25.877833 3934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:25.890995 3934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:25.894898 3934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:25.895157 3934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:25.913057 3934 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39723
I20260807 20:00:25.913076 4022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39723 every 8 connection(s)
I20260807 20:00:25.914390 3934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:25.917445 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 3934
I20260807 20:00:25.917603 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:25.918020 5910 external_mini_cluster.cc:1428] Setting key 76801659089d1d47b15ed66828338e52
I20260807 20:00:25.918041 4023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:25.932067 4023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578: Bootstrap starting.
Aug 07 20:00:25 dist-test-slave-6bbx krb5kdc[3916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:00:25.935084 4023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:25.936177 4023 log.cc:824] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:25.938762 4023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578: No bootstrap required, opened a new log
I20260807 20:00:25.940297 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:25.919727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46697 (local address 127.0.0.1:39723)
0807 20:00:25.920506 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:25.920518 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:25.920560 (+ 42us) server_negotiation.cc:407] Connection header received
0807 20:00:25.922478 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:25.922499 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:25.922876 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:25.923197 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:25.925051 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:25.926370 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:25.928164 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:25.928844 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:25.928992 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:25.933541 (+ 4549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:25.933549 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:25.933562 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:25.933609 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:25.936495 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:25.937156 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:25.937165 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:25.937171 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:25.937328 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:25.937685 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:25.937689 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:25.937691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:25.938171 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:25.938449 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:25.938881 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 20:00:25.939271 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":342,"threads_started":1}
I20260807 20:00:25.944046 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:25.946858 4023 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e5eb85479848db9f349bf7327fb578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39723 } }
I20260807 20:00:25.947250 4023 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:25.947346 4023 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e5eb85479848db9f349bf7327fb578, State: Initialized, Role: FOLLOWER
I20260807 20:00:25.947907 4023 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e5eb85479848db9f349bf7327fb578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39723 } }
I20260807 20:00:25.948196 4023 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:25.948393 4023 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:25.948562 4023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:25.951048 4023 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e5eb85479848db9f349bf7327fb578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39723 } }
I20260807 20:00:25.951596 4023 leader_election.cc:302] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10e5eb85479848db9f349bf7327fb578; no voters:
I20260807 20:00:25.952231 4023 leader_election.cc:288] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:25.952363 4039 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:25.952971 4039 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [term 1 LEADER]: Becoming Leader. State: Replica: 10e5eb85479848db9f349bf7327fb578, State: Running, Role: LEADER
I20260807 20:00:25.953620 4039 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e5eb85479848db9f349bf7327fb578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39723 } }
I20260807 20:00:25.955889 4023 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:25.956550 4041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10e5eb85479848db9f349bf7327fb578. Latest consensus state: current_term: 1 leader_uuid: "10e5eb85479848db9f349bf7327fb578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e5eb85479848db9f349bf7327fb578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39723 } } }
I20260807 20:00:25.957070 4041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:25.956534 4042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10e5eb85479848db9f349bf7327fb578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e5eb85479848db9f349bf7327fb578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39723 } } }
I20260807 20:00:25.957782 4042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:25.960386 4044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:25.963551 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:25.948223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40917 (local address 127.0.0.1:39723)
0807 20:00:25.948387 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:25.948394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:25.948823 (+ 429us) server_negotiation.cc:407] Connection header received
0807 20:00:25.948937 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:25.948942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:25.949019 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:25.949134 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:25.950417 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:25.951431 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:25.953045 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:25.953695 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:25.953829 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:25.956898 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:25.956905 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:25.956910 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:25.956955 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:25.960671 (+ 3716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:25.961305 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:25.961310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:25.961314 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:25.961463 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:25.961799 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:25.961804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:25.961807 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:25.962281 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:25.962591 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:25.962910 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 20:00:25.963141 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 20:00:25.966619 4044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:25.978904 4044 catalog_manager.cc:1347] Generated new cluster ID: 9c0ccbb8e7784c9c9998f1e75ce200fb
I20260807 20:00:25.979039 4044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:26.017243 4044 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:26.018581 4044 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:26.031251 4044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10e5eb85479848db9f349bf7327fb578: Generated new TSK 0
I20260807 20:00:26.032071 4044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:26.043270 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 3934
I20260807 20:00:26.044529 4017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:26.137584 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 3934
2026-08-07T20:00:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2170 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:26 dist-test-slave-6bbx krb5kdc[4068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:26 dist-test-slave-6bbx krb5kdc[4068](info): set up 2 sockets
Aug 07 20:00:26 dist-test-slave-6bbx krb5kdc[4068](info): commencing operation
krb5kdc: starting...
W20260807 20:00:27.351605 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.005s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:27 dist-test-slave-6bbx krb5kdc[4068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:27.682602 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43569
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:28.015614 4083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:28.015939 4083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:28.016088 4083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:28.023793 4083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:28.023916 4083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:28.023998 4083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:28.024080 4083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:28.024150 4083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:28.033793 4083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:28.035008 4083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:28.036341 4083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:28.047834 4098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:28.047915 4100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:28.047890 4095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:28.048667 4083 server_base.cc:1034] running on GCE node
I20260807 20:00:28.049407 4083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:28.050738 4083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:28.052003 4083 hybrid_clock.cc:648] HybridClock initialized: now 1786132828051942 us; error 53 us; skew 500 ppm
I20260807 20:00:28.052347 4083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:28 dist-test-slave-6bbx krb5kdc[4068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132828, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:28.055243 4083 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:28.056572 4083 webserver.cc:460] Webserver started at http://127.0.0.1:33031/ using document root <none> and password file <none>
I20260807 20:00:28.057224 4083 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:28.057338 4083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:28.057610 4083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:28.060534 4083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "8e7253faa76847f79ba10579c7290828"
format_stamp: "Formatted at 2026-08-07 20:00:28 on dist-test-slave-6bbx"
server_key: "d6cbb4191ea24dbec4523f91c2edd2ea"
server_key_iv: "a32963dd4a5ab65a51c4d9c282685375"
server_key_version: "encryptionkey@0"
I20260807 20:00:28.061275 4083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "8e7253faa76847f79ba10579c7290828"
format_stamp: "Formatted at 2026-08-07 20:00:28 on dist-test-slave-6bbx"
server_key: "d6cbb4191ea24dbec4523f91c2edd2ea"
server_key_iv: "a32963dd4a5ab65a51c4d9c282685375"
server_key_version: "encryptionkey@0"
I20260807 20:00:28.066113 4083 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 20:00:28.069442 4108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:28.070668 4083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 20:00:28.070827 4083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "8e7253faa76847f79ba10579c7290828"
format_stamp: "Formatted at 2026-08-07 20:00:28 on dist-test-slave-6bbx"
server_key: "d6cbb4191ea24dbec4523f91c2edd2ea"
server_key_iv: "a32963dd4a5ab65a51c4d9c282685375"
server_key_version: "encryptionkey@0"
I20260807 20:00:28.070993 4083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:28.085665 4083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:28.089273 4083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:28.089510 4083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:28.106353 4083 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43569
I20260807 20:00:28.106396 4169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43569 every 8 connection(s)
I20260807 20:00:28.107620 4083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:28.111205 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 4083
I20260807 20:00:28.111259 4170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:28.111393 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:28.111861 5910 external_mini_cluster.cc:1428] Setting key fce19e3334886794ee7815bbe8c7f8c0
I20260807 20:00:28.125684 4176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:28.113527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55381 (local address 127.0.0.1:43569)
0807 20:00:28.114411 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:28.114425 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:28.114479 (+ 54us) server_negotiation.cc:407] Connection header received
0807 20:00:28.116186 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:28.116222 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:28.116692 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:28.117105 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:28.117617 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:28.119584 (+ 1967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:28.120859 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:28.121852 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:28.122043 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:28.123080 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:28.123090 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:28.123110 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:28.123835 (+ 725us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:28.123927 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:28.123960 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:28.124087 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:28.124249 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 20:00:28.124484 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":363,"threads_started":1}
I20260807 20:00:28.126183 4170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828: Bootstrap starting.
I20260807 20:00:28.129345 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:28.129771 4170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:28.130728 4170 log.cc:824] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:28.133400 4170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828: No bootstrap required, opened a new log
I20260807 20:00:28.140058 4176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:28.133648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34251 (local address 127.0.0.1:43569)
0807 20:00:28.133852 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:28.133858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:28.134242 (+ 384us) server_negotiation.cc:407] Connection header received
0807 20:00:28.134398 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:28.134401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:28.134456 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:28.134526 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:28.135106 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:28.135893 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:28.137729 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:28.138147 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:28.138249 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:28.139373 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:28.139377 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:28.139380 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:28.139399 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:28.139437 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:28.139455 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:28.139527 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:28.139691 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 20:00:28.139763 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 20:00:28.142843 4170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7253faa76847f79ba10579c7290828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43569 } }
I20260807 20:00:28.143172 4170 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:28.143262 4170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7253faa76847f79ba10579c7290828, State: Initialized, Role: FOLLOWER
I20260807 20:00:28.143833 4170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7253faa76847f79ba10579c7290828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43569 } }
I20260807 20:00:28.144053 4170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:28.144177 4170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:28.144330 4170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:28.146651 4170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7253faa76847f79ba10579c7290828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43569 } }
I20260807 20:00:28.147133 4170 leader_election.cc:302] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e7253faa76847f79ba10579c7290828; no voters:
I20260807 20:00:28.147684 4170 leader_election.cc:288] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:28.147818 4186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:28.148443 4186 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [term 1 LEADER]: Becoming Leader. State: Replica: 8e7253faa76847f79ba10579c7290828, State: Running, Role: LEADER
I20260807 20:00:28.148936 4186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7253faa76847f79ba10579c7290828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43569 } }
I20260807 20:00:28.149624 4170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:28.152582 4190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e7253faa76847f79ba10579c7290828. Latest consensus state: current_term: 1 leader_uuid: "8e7253faa76847f79ba10579c7290828" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7253faa76847f79ba10579c7290828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43569 } } }
I20260807 20:00:28.153030 4190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:28.152906 4187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e7253faa76847f79ba10579c7290828" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7253faa76847f79ba10579c7290828" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43569 } } }
I20260807 20:00:28.153211 4187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:28.154019 4200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:28.159579 4200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:28.168928 4200 catalog_manager.cc:1347] Generated new cluster ID: f00ff91d20f74cedbac87e73fd7f5091
I20260807 20:00:28.169042 4200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:28.191967 4200 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:28.193852 4200 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:28.202982 4200 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e7253faa76847f79ba10579c7290828: Generated new TSK 0
I20260807 20:00:28.204013 4200 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:28.210731 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4083
W20260807 20:00:28.211843 4165 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55381
W20260807 20:00:28.212487 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4083: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:28.212608 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 4083
2026-08-07T20:00:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2074 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:28 dist-test-slave-6bbx krb5kdc[4215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:28 dist-test-slave-6bbx krb5kdc[4215](info): set up 2 sockets
Aug 07 20:00:28 dist-test-slave-6bbx krb5kdc[4215](info): commencing operation
krb5kdc: starting...
W20260807 20:00:29.434084 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:29 dist-test-slave-6bbx krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:29.751910 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44783
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:30.090986 4236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:30.091257 4236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:30.091398 4236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:30.098361 4236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:30.098467 4236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:30.098541 4236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:30.098623 4236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:30.098678 4236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:30.108238 4236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:30.109498 4236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:30.110826 4236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:30.122042 4245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:30.122110 4243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:30.122159 4247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:30.122957 4236 server_base.cc:1034] running on GCE node
I20260807 20:00:30.123724 4236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:30.125006 4236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:30.126199 4236 hybrid_clock.cc:648] HybridClock initialized: now 1786132830126155 us; error 34 us; skew 500 ppm
I20260807 20:00:30.126528 4236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:30 dist-test-slave-6bbx krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132830, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:30.129477 4236 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:30.130915 4236 webserver.cc:460] Webserver started at http://127.0.0.1:38341/ using document root <none> and password file <none>
I20260807 20:00:30.131578 4236 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:30.131726 4236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:30.132019 4236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:30.134935 4236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "22e9d15510914efdb34dbaf20d483041"
format_stamp: "Formatted at 2026-08-07 20:00:30 on dist-test-slave-6bbx"
server_key: "54a2312433904ba1d7ad9e5d2c4640a9"
server_key_iv: "450997b349940d42e88fa22cc0fd542b"
server_key_version: "encryptionkey@0"
I20260807 20:00:30.135696 4236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "22e9d15510914efdb34dbaf20d483041"
format_stamp: "Formatted at 2026-08-07 20:00:30 on dist-test-slave-6bbx"
server_key: "54a2312433904ba1d7ad9e5d2c4640a9"
server_key_iv: "450997b349940d42e88fa22cc0fd542b"
server_key_version: "encryptionkey@0"
I20260807 20:00:30.140489 4236 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 20:00:30.143853 4259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:30.145028 4236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 20:00:30.145186 4236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "22e9d15510914efdb34dbaf20d483041"
format_stamp: "Formatted at 2026-08-07 20:00:30 on dist-test-slave-6bbx"
server_key: "54a2312433904ba1d7ad9e5d2c4640a9"
server_key_iv: "450997b349940d42e88fa22cc0fd542b"
server_key_version: "encryptionkey@0"
I20260807 20:00:30.145366 4236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:30.150808 4236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:30.154579 4236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:30.154843 4236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:30.171974 4236 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44783
I20260807 20:00:30.172039 4319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44783 every 8 connection(s)
I20260807 20:00:30.173326 4236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:30.177004 4320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:30.181989 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 4236
I20260807 20:00:30.182188 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:30.182582 5910 external_mini_cluster.cc:1428] Setting key 7e881b0e19ba618bfd87b477066c6a83
I20260807 20:00:30.188812 4320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041: Bootstrap starting.
I20260807 20:00:30.191243 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:30.184337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43883 (local address 127.0.0.1:44783)
0807 20:00:30.185168 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:30.185188 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:30.185239 (+ 51us) server_negotiation.cc:407] Connection header received
0807 20:00:30.187558 (+ 2319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:30.187585 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:30.188021 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:30.188427 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:30.189374 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:30.189383 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:30.189399 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:30.189416 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:30.189481 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:30.189507 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:30.189734 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:30.189862 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 20:00:30.190043 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":329,"threads_started":1}
I20260807 20:00:30.192520 4320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:30.193548 4320 log.cc:824] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:30.194896 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:30.196314 4320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041: No bootstrap required, opened a new log
I20260807 20:00:30.201277 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:30.199072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55947 (local address 127.0.0.1:44783)
0807 20:00:30.199239 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:30.199245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:30.199558 (+ 313us) server_negotiation.cc:407] Connection header received
0807 20:00:30.199695 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:30.199704 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:30.199769 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:30.199877 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:30.200644 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:30.200650 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:30.200655 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:30.200672 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:30.200725 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:30.200748 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:30.200871 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:30.200937 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 20:00:30.200991 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 20:00:30.204536 4320 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e9d15510914efdb34dbaf20d483041" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44783 } }
I20260807 20:00:30.204856 4320 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:30.204929 4320 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e9d15510914efdb34dbaf20d483041, State: Initialized, Role: FOLLOWER
I20260807 20:00:30.205406 4320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e9d15510914efdb34dbaf20d483041" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44783 } }
I20260807 20:00:30.205611 4320 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:30.205706 4320 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:30.205832 4320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:30.208101 4320 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e9d15510914efdb34dbaf20d483041" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44783 } }
I20260807 20:00:30.208551 4320 leader_election.cc:302] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e9d15510914efdb34dbaf20d483041; no voters:
I20260807 20:00:30.209052 4320 leader_election.cc:288] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:30.209173 4337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:30.209772 4337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [term 1 LEADER]: Becoming Leader. State: Replica: 22e9d15510914efdb34dbaf20d483041, State: Running, Role: LEADER
I20260807 20:00:30.210285 4337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e9d15510914efdb34dbaf20d483041" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44783 } }
I20260807 20:00:30.210927 4320 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:30.213054 4338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22e9d15510914efdb34dbaf20d483041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e9d15510914efdb34dbaf20d483041" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44783 } } }
I20260807 20:00:30.213425 4338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:30.213799 4339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e9d15510914efdb34dbaf20d483041. Latest consensus state: current_term: 1 leader_uuid: "22e9d15510914efdb34dbaf20d483041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e9d15510914efdb34dbaf20d483041" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44783 } } }
I20260807 20:00:30.214068 4339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:30.215646 4344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:30.220598 4344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:30.228936 4344 catalog_manager.cc:1347] Generated new cluster ID: 9c39c0ebd163406cba727dd5a742fc34
I20260807 20:00:30.229034 4344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:30.257421 4344 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:30.257830 4344 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:30.275789 4344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22e9d15510914efdb34dbaf20d483041: Generated new TSK 0
I20260807 20:00:30.276618 4344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:30.291267 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4236
W20260807 20:00:30.292322 4315 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43883
W20260807 20:00:30.292934 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4236: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:30.293066 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 4236
2026-08-07T20:00:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2082 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:30 dist-test-slave-6bbx krb5kdc[4364](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:30 dist-test-slave-6bbx krb5kdc[4364](info): set up 2 sockets
Aug 07 20:00:30 dist-test-slave-6bbx krb5kdc[4364](info): commencing operation
krb5kdc: starting...
W20260807 20:00:31.508373 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.001s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:31 dist-test-slave-6bbx krb5kdc[4364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:31.809101 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33779
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:32.143616 4384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:32.143934 4384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:32.144083 4384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:32.151181 4384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:32.151283 4384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:32.151356 4384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:32.151432 4384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:32.151492 4384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:32.161114 4384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:32.162411 4384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:32.163766 4384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:32.175071 4390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:32.175091 4389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:32.175113 4392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:32.176138 4384 server_base.cc:1034] running on GCE node
I20260807 20:00:32.176877 4384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:32.178206 4384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:32.179421 4384 hybrid_clock.cc:648] HybridClock initialized: now 1786132832179382 us; error 25 us; skew 500 ppm
I20260807 20:00:32.179809 4384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:32 dist-test-slave-6bbx krb5kdc[4364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132832, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:32.182853 4384 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:32.184398 4384 webserver.cc:460] Webserver started at http://127.0.0.1:38145/ using document root <none> and password file <none>
I20260807 20:00:32.185077 4384 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:32.185246 4384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:32.185559 4384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:32.188551 4384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "4998002345114f05b9eff9a400ae3815"
format_stamp: "Formatted at 2026-08-07 20:00:32 on dist-test-slave-6bbx"
server_key: "07cb7b0fcd432f0c6d3cff8d6b30d24b"
server_key_iv: "4bcbd23eab82d41dbdda401aa6915d1c"
server_key_version: "encryptionkey@0"
I20260807 20:00:32.189337 4384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "4998002345114f05b9eff9a400ae3815"
format_stamp: "Formatted at 2026-08-07 20:00:32 on dist-test-slave-6bbx"
server_key: "07cb7b0fcd432f0c6d3cff8d6b30d24b"
server_key_iv: "4bcbd23eab82d41dbdda401aa6915d1c"
server_key_version: "encryptionkey@0"
I20260807 20:00:32.194381 4384 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 20:00:32.197700 4403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:32.198995 4384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:32.199164 4384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "4998002345114f05b9eff9a400ae3815"
format_stamp: "Formatted at 2026-08-07 20:00:32 on dist-test-slave-6bbx"
server_key: "07cb7b0fcd432f0c6d3cff8d6b30d24b"
server_key_iv: "4bcbd23eab82d41dbdda401aa6915d1c"
server_key_version: "encryptionkey@0"
I20260807 20:00:32.199342 4384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:32.214504 4384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:32.218140 4384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:32.218405 4384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:32.235447 4384 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33779
I20260807 20:00:32.235466 4481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33779 every 8 connection(s)
I20260807 20:00:32.236788 4384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:32.240651 4482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:32.246413 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 4384
I20260807 20:00:32.246580 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:32.246984 5910 external_mini_cluster.cc:1428] Setting key 2de15125e76905264716d5a7411af861
I20260807 20:00:32.251190 4482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815: Bootstrap starting.
I20260807 20:00:32.254693 4482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:32.255924 4482 log.cc:824] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:32.259055 4482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815: No bootstrap required, opened a new log
Aug 07 20:00:32 dist-test-slave-6bbx krb5kdc[4364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:00:32.268874 4482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4998002345114f05b9eff9a400ae3815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33779 } }
I20260807 20:00:32.269331 4482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:32.269441 4482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4998002345114f05b9eff9a400ae3815, State: Initialized, Role: FOLLOWER
I20260807 20:00:32.270110 4482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4998002345114f05b9eff9a400ae3815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33779 } }
I20260807 20:00:32.270371 4482 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:32.270521 4482 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:32.270689 4482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:32.271229 4486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:32.248776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:38261 (local address 127.0.0.1:33779)
0807 20:00:32.249523 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:32.249534 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:32.249573 (+ 39us) server_negotiation.cc:407] Connection header received
0807 20:00:32.251173 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:32.251197 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:32.251583 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:32.251932 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:32.253688 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:32.255011 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:32.256754 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:32.257756 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:32.257885 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:32.262700 (+ 4815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:32.262710 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:32.262729 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:32.262775 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:32.266785 (+ 4010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:32.267621 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:32.267630 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:32.267638 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:32.267871 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:32.268303 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:32.268307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:32.268310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:32.268999 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:32.269329 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:32.269848 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 20:00:32.270132 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":321,"threads_started":1}
I20260807 20:00:32.273063 4482 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4998002345114f05b9eff9a400ae3815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33779 } }
I20260807 20:00:32.273592 4482 leader_election.cc:302] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4998002345114f05b9eff9a400ae3815; no voters:
I20260807 20:00:32.274216 4482 leader_election.cc:288] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:32.274365 4489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:32.274958 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:32.275990 4489 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [term 1 LEADER]: Becoming Leader. State: Replica: 4998002345114f05b9eff9a400ae3815, State: Running, Role: LEADER
I20260807 20:00:32.276531 4482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:32.276577 4489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4998002345114f05b9eff9a400ae3815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33779 } }
I20260807 20:00:32.285740 4492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4998002345114f05b9eff9a400ae3815. Latest consensus state: current_term: 1 leader_uuid: "4998002345114f05b9eff9a400ae3815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4998002345114f05b9eff9a400ae3815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33779 } } }
I20260807 20:00:32.286010 4492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:32.285122 4490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4998002345114f05b9eff9a400ae3815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4998002345114f05b9eff9a400ae3815" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33779 } } }
I20260807 20:00:32.286500 4490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815 [sys.catalog]: This master's current role is: LEADER
W20260807 20:00:32.291465 4513 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:00:32.291606 4513 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:00:32.291769 4514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:32.293896 4514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:32.302889 4514 catalog_manager.cc:1347] Generated new cluster ID: 42950b8602544eb4b98f4a5ffffefa26
I20260807 20:00:32.302987 4514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:32.312155 4486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:32.290051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:49897 (local address 127.0.0.1:33779)
0807 20:00:32.290248 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:32.290255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:32.296317 (+ 6062us) server_negotiation.cc:407] Connection header received
0807 20:00:32.296494 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:32.296499 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:32.296574 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:32.296657 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:32.298418 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:32.299605 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:32.301170 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:32.301857 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:32.301987 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:32.305334 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:32.305342 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:32.305347 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:32.305384 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:32.308949 (+ 3565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:32.309826 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:32.309832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:32.309835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:32.310018 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:32.310491 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:32.310496 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:32.310500 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:32.310917 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:32.311175 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:32.311529 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 20:00:32.311759 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 20:00:32.317720 4514 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:32.318917 4514 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:32.325459 4514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4998002345114f05b9eff9a400ae3815: Generated new TSK 0
I20260807 20:00:32.326398 4514 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:32.332101 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4384
I20260807 20:00:32.333302 4477 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:32.421069 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 4384
W20260807 20:00:32.445591 4362 connection.cc:535] client connection to 127.0.0.1:33779 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33779): Connection reset by peer (error 104)
2026-08-07T20:00:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2126 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:32 dist-test-slave-6bbx krb5kdc[4528](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:32 dist-test-slave-6bbx krb5kdc[4528](info): set up 2 sockets
Aug 07 20:00:32 dist-test-slave-6bbx krb5kdc[4528](info): commencing operation
krb5kdc: starting...
W20260807 20:00:33.634408 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:33 dist-test-slave-6bbx krb5kdc[4528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:33.944615 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46601
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:34.275190 4546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:34.275478 4546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:34.275607 4546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:34.282552 4546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:34.282658 4546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:34.282732 4546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:34.282809 4546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:34.282867 4546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:34.292395 4546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:34.293620 4546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:34.294915 4546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:34.306173 4553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:34.306210 4556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:34.306130 4558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:34.306948 4546 server_base.cc:1034] running on GCE node
I20260807 20:00:34.307735 4546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:34.309057 4546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:34.310249 4546 hybrid_clock.cc:648] HybridClock initialized: now 1786132834310203 us; error 37 us; skew 500 ppm
I20260807 20:00:34.310585 4546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:34 dist-test-slave-6bbx krb5kdc[4528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132834, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:34.319437 4546 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:34.320924 4546 webserver.cc:460] Webserver started at http://127.0.0.1:38577/ using document root <none> and password file <none>
I20260807 20:00:34.321578 4546 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:34.321676 4546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:34.321931 4546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:34.324859 4546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "5586b80c4fd648268b59392a50827ab7"
format_stamp: "Formatted at 2026-08-07 20:00:34 on dist-test-slave-6bbx"
server_key: "b1b65d4639b5811bc273b1e63b5191ed"
server_key_iv: "9ab1b489e9b8117eeb192e8a1dc8dc10"
server_key_version: "encryptionkey@0"
I20260807 20:00:34.325553 4546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "5586b80c4fd648268b59392a50827ab7"
format_stamp: "Formatted at 2026-08-07 20:00:34 on dist-test-slave-6bbx"
server_key: "b1b65d4639b5811bc273b1e63b5191ed"
server_key_iv: "9ab1b489e9b8117eeb192e8a1dc8dc10"
server_key_version: "encryptionkey@0"
I20260807 20:00:34.330381 4546 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 20:00:34.333609 4573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:34.334882 4546 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:34.335037 4546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "5586b80c4fd648268b59392a50827ab7"
format_stamp: "Formatted at 2026-08-07 20:00:34 on dist-test-slave-6bbx"
server_key: "b1b65d4639b5811bc273b1e63b5191ed"
server_key_iv: "9ab1b489e9b8117eeb192e8a1dc8dc10"
server_key_version: "encryptionkey@0"
I20260807 20:00:34.335204 4546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:34.353889 4546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:34.357933 4546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:34.358197 4546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:34.375372 4546 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46601
I20260807 20:00:34.375396 4645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46601 every 8 connection(s)
I20260807 20:00:34.376698 4546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:34.380360 4646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:34.381115 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 4546
I20260807 20:00:34.381313 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:34.381744 5910 external_mini_cluster.cc:1428] Setting key 9b9c776c139fab31e8599bcc117bbbc7
I20260807 20:00:34.393507 4646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7: Bootstrap starting.
I20260807 20:00:34.395506 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:34.383498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:43139 (local address 127.0.0.1:46601)
0807 20:00:34.384285 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:34.384297 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:34.384350 (+ 53us) server_negotiation.cc:407] Connection header received
0807 20:00:34.386156 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:34.386181 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:34.386579 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:34.386959 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:34.387535 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:34.388889 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:34.390825 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:34.391554 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:34.391748 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:34.393108 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:34.393117 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:34.393131 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:34.393756 (+ 625us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:34.393859 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:34.393892 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:34.394026 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:34.394289 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 20:00:34.394469 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":377,"threads_started":1}
I20260807 20:00:34.396906 4646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:34.397960 4646 log.cc:824] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:34.399283 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:34.400810 4646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7: No bootstrap required, opened a new log
I20260807 20:00:34.409608 4646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5586b80c4fd648268b59392a50827ab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46601 } }
I20260807 20:00:34.409987 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:34.403470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:48325 (local address 127.0.0.1:46601)
0807 20:00:34.403656 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:34.403684 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:34.404107 (+ 423us) server_negotiation.cc:407] Connection header received
0807 20:00:34.404261 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:34.404267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:34.404348 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:34.404445 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:34.404941 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:34.406098 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:34.407395 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:34.408115 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:34.408242 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:34.409269 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:34.409275 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:34.409280 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:34.409301 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:34.409364 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:34.409386 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:34.409500 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:34.409629 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 20:00:34.409685 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 20:00:34.410120 4646 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:34.410244 4646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5586b80c4fd648268b59392a50827ab7, State: Initialized, Role: FOLLOWER
I20260807 20:00:34.410874 4646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5586b80c4fd648268b59392a50827ab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46601 } }
I20260807 20:00:34.411131 4646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:34.411270 4646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:34.411441 4646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:34.413589 4646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5586b80c4fd648268b59392a50827ab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46601 } }
I20260807 20:00:34.414083 4646 leader_election.cc:302] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5586b80c4fd648268b59392a50827ab7; no voters:
I20260807 20:00:34.414687 4646 leader_election.cc:288] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:34.414795 4662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:34.415416 4662 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 5586b80c4fd648268b59392a50827ab7, State: Running, Role: LEADER
I20260807 20:00:34.416066 4662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5586b80c4fd648268b59392a50827ab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46601 } }
I20260807 20:00:34.416937 4646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:34.419080 4663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5586b80c4fd648268b59392a50827ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5586b80c4fd648268b59392a50827ab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46601 } } }
I20260807 20:00:34.419196 4664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5586b80c4fd648268b59392a50827ab7. Latest consensus state: current_term: 1 leader_uuid: "5586b80c4fd648268b59392a50827ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5586b80c4fd648268b59392a50827ab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46601 } } }
I20260807 20:00:34.419489 4663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:34.419521 4664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7 [sys.catalog]: This master's current role is: LEADER
W20260807 20:00:34.430258 4682 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:00:34.430362 4682 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:00:34.430478 4671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:34.432611 4671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:34.440963 4671 catalog_manager.cc:1347] Generated new cluster ID: 979d58428ef6457f970de4382def2e41
I20260807 20:00:34.441098 4671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:34.465250 4671 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:34.466980 4671 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:34.481024 4671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5586b80c4fd648268b59392a50827ab7: Generated new TSK 0
I20260807 20:00:34.482087 4671 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:34.502640 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4546
W20260807 20:00:34.503979 4640 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.28:43139
W20260807 20:00:34.504746 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4546: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:34.504906 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 4546
W20260807 20:00:34.527452 4525 connection.cc:535] client connection to 127.0.0.1:46601 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46601): Connection reset by peer (error 104)
2026-08-07T20:00:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2081 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:34 dist-test-slave-6bbx krb5kdc[4689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:34 dist-test-slave-6bbx krb5kdc[4689](info): set up 2 sockets
Aug 07 20:00:34 dist-test-slave-6bbx krb5kdc[4689](info): commencing operation
krb5kdc: starting...
W20260807 20:00:35.714872 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:35 dist-test-slave-6bbx krb5kdc[4689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:36.039110 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45371
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:36.384945 4705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:36.385249 4705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:36.385353 4705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:36.392488 4705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:36.392604 4705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:36.392668 4705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:36.392729 4705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:36.392773 4705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:36.402755 4705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45371
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:36.404037 4705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:36.405339 4705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:36.416589 4712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:36.416567 4715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:36.416528 4713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:36.417299 4705 server_base.cc:1034] running on GCE node
I20260807 20:00:36.418185 4705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:36.419531 4705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:36.420737 4705 hybrid_clock.cc:648] HybridClock initialized: now 1786132836420682 us; error 42 us; skew 500 ppm
I20260807 20:00:36.421087 4705 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:36 dist-test-slave-6bbx krb5kdc[4689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132836, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:36.424086 4705 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:36.425450 4705 webserver.cc:460] Webserver started at http://127.0.0.1:37907/ using document root <none> and password file <none>
I20260807 20:00:36.426105 4705 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:36.426222 4705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:36.426512 4705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:36.429373 4705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "9155b1dfa5fa45e2916999cf3cdd98ee"
format_stamp: "Formatted at 2026-08-07 20:00:36 on dist-test-slave-6bbx"
server_key: "7984ffd30a8e6fa1aae5fa3fea3965f8"
server_key_iv: "e0b0aa74872d5e27760431fbacdb9249"
server_key_version: "encryptionkey@0"
I20260807 20:00:36.430094 4705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "9155b1dfa5fa45e2916999cf3cdd98ee"
format_stamp: "Formatted at 2026-08-07 20:00:36 on dist-test-slave-6bbx"
server_key: "7984ffd30a8e6fa1aae5fa3fea3965f8"
server_key_iv: "e0b0aa74872d5e27760431fbacdb9249"
server_key_version: "encryptionkey@0"
I20260807 20:00:36.434924 4705 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 20:00:36.438216 4724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:36.439445 4705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:36.439601 4705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "9155b1dfa5fa45e2916999cf3cdd98ee"
format_stamp: "Formatted at 2026-08-07 20:00:36 on dist-test-slave-6bbx"
server_key: "7984ffd30a8e6fa1aae5fa3fea3965f8"
server_key_iv: "e0b0aa74872d5e27760431fbacdb9249"
server_key_version: "encryptionkey@0"
I20260807 20:00:36.439807 4705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:36.445138 4705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:36.448897 4705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:36.449153 4705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:36.466228 4705 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45371
I20260807 20:00:36.466272 4790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45371 every 8 connection(s)
I20260807 20:00:36.467510 4705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:36.468845 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 4705
I20260807 20:00:36.469017 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:36.469444 5910 external_mini_cluster.cc:1428] Setting key 53aed5f920a4458b80cfd015c0134fd2
I20260807 20:00:36.471601 4793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:36.477983 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:36.471137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:48405 (local address 127.0.0.1:45371)
0807 20:00:36.471984 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:36.471998 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:36.472048 (+ 50us) server_negotiation.cc:407] Connection header received
0807 20:00:36.474238 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:36.474266 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:36.474703 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:36.475137 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:36.476112 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:36.476121 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:36.476137 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:36.476155 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:36.476244 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:36.476268 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:36.476482 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:36.476618 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 20:00:36.476809 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":304,"threads_started":1}
I20260807 20:00:36.481326 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:36.485261 4793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee: Bootstrap starting.
I20260807 20:00:36.488998 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:36.486528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:58713 (local address 127.0.0.1:45371)
0807 20:00:36.486725 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:36.486735 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:36.487195 (+ 460us) server_negotiation.cc:407] Connection header received
0807 20:00:36.487374 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:36.487377 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:36.487423 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:36.487502 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:36.488436 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:36.488440 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:36.488443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:36.488460 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:36.488496 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:36.488509 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:36.488593 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:36.488708 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 20:00:36.488750 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 20:00:36.489140 4793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:36.490374 4793 log.cc:824] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:36.493475 4793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee: No bootstrap required, opened a new log
I20260807 20:00:36.500551 4793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45371 } }
I20260807 20:00:36.500949 4793 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:36.501065 4793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9155b1dfa5fa45e2916999cf3cdd98ee, State: Initialized, Role: FOLLOWER
I20260807 20:00:36.501675 4793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45371 } }
I20260807 20:00:36.501896 4793 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:36.502025 4793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:36.502204 4793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:36.504370 4793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45371 } }
I20260807 20:00:36.504835 4793 leader_election.cc:302] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9155b1dfa5fa45e2916999cf3cdd98ee; no voters:
I20260807 20:00:36.505388 4793 leader_election.cc:288] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:36.505514 4808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:36.506142 4808 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [term 1 LEADER]: Becoming Leader. State: Replica: 9155b1dfa5fa45e2916999cf3cdd98ee, State: Running, Role: LEADER
I20260807 20:00:36.506682 4808 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45371 } }
I20260807 20:00:36.507239 4793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:36.509416 4809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45371 } } }
I20260807 20:00:36.509454 4810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9155b1dfa5fa45e2916999cf3cdd98ee. Latest consensus state: current_term: 1 leader_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9155b1dfa5fa45e2916999cf3cdd98ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45371 } } }
I20260807 20:00:36.509896 4809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:36.509896 4810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:36.511467 4814 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:36.516448 4814 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:36.525029 4814 catalog_manager.cc:1347] Generated new cluster ID: 9568f331a8144bfd91dd0c652d9d7f62
I20260807 20:00:36.525123 4814 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:36.546368 4814 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:36.546814 4814 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:36.558941 4814 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9155b1dfa5fa45e2916999cf3cdd98ee: Generated new TSK 0
I20260807 20:00:36.559933 4814 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:36.571008 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4705
W20260807 20:00:36.572129 4785 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.28:48405
W20260807 20:00:36.572719 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4705: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:36.572857 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 4705
2026-08-07T20:00:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2069 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:36 dist-test-slave-6bbx krb5kdc[4834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:36 dist-test-slave-6bbx krb5kdc[4834](info): set up 2 sockets
Aug 07 20:00:36 dist-test-slave-6bbx krb5kdc[4834](info): commencing operation
krb5kdc: starting...
W20260807 20:00:37.781153 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.001s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:37 dist-test-slave-6bbx krb5kdc[4834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:38.090204 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46683
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:38.424484 4851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:38.424789 4851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:38.424942 4851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:38.431919 4851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:38.432029 4851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:38.432101 4851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:38.432188 4851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:38.432247 4851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:38.441761 4851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46683
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:38.443046 4851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:38.444342 4851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:38.455506 4861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:38.455554 4857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:38.455518 4859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:38.456524 4851 server_base.cc:1034] running on GCE node
I20260807 20:00:38.457266 4851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:38.458601 4851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:38.459751 4851 hybrid_clock.cc:648] HybridClock initialized: now 1786132838459709 us; error 35 us; skew 500 ppm
I20260807 20:00:38.460170 4851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:38 dist-test-slave-6bbx krb5kdc[4834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132838, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:38.463114 4851 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:38.464498 4851 webserver.cc:460] Webserver started at http://127.0.0.1:33843/ using document root <none> and password file <none>
I20260807 20:00:38.465157 4851 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:38.465269 4851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:38.465541 4851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:38.468468 4851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "8fb0f4ae233c447483a4d9e4ae8907d3"
format_stamp: "Formatted at 2026-08-07 20:00:38 on dist-test-slave-6bbx"
server_key: "31586d03cd93d22f1f559f5eb5182d1d"
server_key_iv: "c9b8b63822677852d7e1ce241dde06d0"
server_key_version: "encryptionkey@0"
I20260807 20:00:38.469190 4851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "8fb0f4ae233c447483a4d9e4ae8907d3"
format_stamp: "Formatted at 2026-08-07 20:00:38 on dist-test-slave-6bbx"
server_key: "31586d03cd93d22f1f559f5eb5182d1d"
server_key_iv: "c9b8b63822677852d7e1ce241dde06d0"
server_key_version: "encryptionkey@0"
I20260807 20:00:38.474144 4851 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 20:00:38.477396 4869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:38.478593 4851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 20:00:38.478752 4851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "8fb0f4ae233c447483a4d9e4ae8907d3"
format_stamp: "Formatted at 2026-08-07 20:00:38 on dist-test-slave-6bbx"
server_key: "31586d03cd93d22f1f559f5eb5182d1d"
server_key_iv: "c9b8b63822677852d7e1ce241dde06d0"
server_key_version: "encryptionkey@0"
I20260807 20:00:38.478931 4851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:38.493360 4851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:38.497628 4851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:38.497948 4851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:38.515694 4851 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46683
I20260807 20:00:38.515698 4940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46683 every 8 connection(s)
I20260807 20:00:38.517098 4851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:38.520731 4941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:38.527076 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 4851
I20260807 20:00:38.527269 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:38.527871 5910 external_mini_cluster.cc:1428] Setting key 1b724729e7b9f805357fb5749f320737
I20260807 20:00:38.531687 4941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3: Bootstrap starting.
I20260807 20:00:38.534750 4941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:38.535804 4941 log.cc:824] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:38.538444 4941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3: No bootstrap required, opened a new log
Aug 07 20:00:38 dist-test-slave-6bbx krb5kdc[4834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:00:38.546530 4941 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46683 } }
I20260807 20:00:38.546856 4941 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:38.546957 4941 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fb0f4ae233c447483a4d9e4ae8907d3, State: Initialized, Role: FOLLOWER
I20260807 20:00:38.547565 4941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46683 } }
I20260807 20:00:38.547907 4941 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:38.548064 4941 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:38.548265 4941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:38.549571 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:38.529664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:36351 (local address 127.0.0.1:46683)
0807 20:00:38.530412 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:38.530424 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:38.530467 (+ 43us) server_negotiation.cc:407] Connection header received
0807 20:00:38.532189 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:38.532216 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:38.532590 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:38.532926 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:38.534375 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:38.535738 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:38.537294 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:38.537941 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:38.538102 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:38.542236 (+ 4134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:38.542244 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:38.542257 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:38.542291 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:38.545322 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:38.546027 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:38.546033 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:38.546039 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:38.546204 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:38.546648 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:38.546651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:38.546653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:38.547251 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:38.547527 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:38.548147 (+ 620us) server_negotiation.cc:299] Negotiation successful
0807 20:00:38.548469 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":329,"threads_started":1}
I20260807 20:00:38.551048 4941 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46683 } }
I20260807 20:00:38.551539 4941 leader_election.cc:302] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fb0f4ae233c447483a4d9e4ae8907d3; no voters:
I20260807 20:00:38.552311 4941 leader_election.cc:288] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:38.552434 4947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:38.553658 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:38.553568 4947 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [term 1 LEADER]: Becoming Leader. State: Replica: 8fb0f4ae233c447483a4d9e4ae8907d3, State: Running, Role: LEADER
I20260807 20:00:38.554100 4947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46683 } }
I20260807 20:00:38.554399 4941 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:38.561046 4948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46683 } } }
I20260807 20:00:38.561468 4948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:38.561916 4949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fb0f4ae233c447483a4d9e4ae8907d3. Latest consensus state: current_term: 1 leader_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fb0f4ae233c447483a4d9e4ae8907d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46683 } } }
I20260807 20:00:38.562186 4949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:38.575780 4961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:38.580761 4961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:38.584723 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:38.569597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:45907 (local address 127.0.0.1:46683)
0807 20:00:38.569766 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:38.569772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:38.570284 (+ 512us) server_negotiation.cc:407] Connection header received
0807 20:00:38.570451 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:38.570456 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:38.570524 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:38.570604 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:38.572081 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:38.572856 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:38.574176 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:38.574750 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:38.574869 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:38.577351 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:38.577375 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:38.577380 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:38.577423 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:38.581168 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:38.582114 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:38.582121 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:38.582125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:38.582289 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:38.582899 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:38.582905 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:38.582908 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:38.583332 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:38.583813 (+ 481us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:38.584142 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 20:00:38.584331 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 20:00:38.589865 4961 catalog_manager.cc:1347] Generated new cluster ID: 833c898bc59a4fcab37609c658a83520
I20260807 20:00:38.590034 4961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:38.612227 4961 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:38.614060 4961 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:38.624938 4961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fb0f4ae233c447483a4d9e4ae8907d3: Generated new TSK 0
I20260807 20:00:38.625941 4961 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:38.631886 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 4851
I20260807 20:00:38.633293 4935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:38.722499 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 4851
W20260807 20:00:38.747429 4832 connection.cc:535] client connection to 127.0.0.1:46683 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46683): Connection reset by peer (error 104)
2026-08-07T20:00:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2151 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:38 dist-test-slave-6bbx krb5kdc[4985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:38 dist-test-slave-6bbx krb5kdc[4985](info): set up 2 sockets
Aug 07 20:00:38 dist-test-slave-6bbx krb5kdc[4985](info): commencing operation
krb5kdc: starting...
W20260807 20:00:39.934480 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:40 dist-test-slave-6bbx krb5kdc[4985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:40.238754 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46441
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:40.578408 5002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:40.578687 5002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:40.578819 5002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:40.585819 5002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:40.585924 5002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:40.585999 5002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:40.586081 5002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:40.586136 5002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:40.595538 5002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46441
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:40.596798 5002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:40.598042 5002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:40.609129 5012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:40.609258 5013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:40.609280 5016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:40.610035 5002 server_base.cc:1034] running on GCE node
I20260807 20:00:40.610766 5002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:40.612104 5002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:40.613318 5002 hybrid_clock.cc:648] HybridClock initialized: now 1786132840613266 us; error 32 us; skew 500 ppm
I20260807 20:00:40.613621 5002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:40 dist-test-slave-6bbx krb5kdc[4985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132840, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:40.621495 5002 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:40.622975 5002 webserver.cc:460] Webserver started at http://127.0.0.1:38751/ using document root <none> and password file <none>
I20260807 20:00:40.623618 5002 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:40.623798 5002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:40.624095 5002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:40.626966 5002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "6c2b3ff3dd614ff68703873814a43713"
format_stamp: "Formatted at 2026-08-07 20:00:40 on dist-test-slave-6bbx"
server_key: "ce20d99e1bf3fd3b2f0f4472542c2200"
server_key_iv: "1c975a3315225e3d0a511eda16177c73"
server_key_version: "encryptionkey@0"
I20260807 20:00:40.627733 5002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "6c2b3ff3dd614ff68703873814a43713"
format_stamp: "Formatted at 2026-08-07 20:00:40 on dist-test-slave-6bbx"
server_key: "ce20d99e1bf3fd3b2f0f4472542c2200"
server_key_iv: "1c975a3315225e3d0a511eda16177c73"
server_key_version: "encryptionkey@0"
I20260807 20:00:40.632603 5002 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 20:00:40.635855 5023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:40.637223 5002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 20:00:40.637393 5002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "6c2b3ff3dd614ff68703873814a43713"
format_stamp: "Formatted at 2026-08-07 20:00:40 on dist-test-slave-6bbx"
server_key: "ce20d99e1bf3fd3b2f0f4472542c2200"
server_key_iv: "1c975a3315225e3d0a511eda16177c73"
server_key_version: "encryptionkey@0"
I20260807 20:00:40.637585 5002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:40.663812 5002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:40.667829 5002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:40.668092 5002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:40.684986 5002 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46441
I20260807 20:00:40.685009 5099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46441 every 8 connection(s)
I20260807 20:00:40.686290 5002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:40.689886 5101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:40.690301 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5002
I20260807 20:00:40.690480 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:40.690881 5910 external_mini_cluster.cc:1428] Setting key e40af3b431d9d71105256e587e06082a
I20260807 20:00:40.703464 5101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713: Bootstrap starting.
I20260807 20:00:40.703955 5104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:40.692645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:53801 (local address 127.0.0.1:46441)
0807 20:00:40.693449 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:40.693460 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:40.693501 (+ 41us) server_negotiation.cc:407] Connection header received
0807 20:00:40.694980 (+ 1479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:40.695000 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:40.695364 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:40.695719 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:40.696323 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:40.697622 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:40.699439 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:40.700176 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:40.700301 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:40.701699 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:40.701706 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:40.701719 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:40.702260 (+ 541us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:40.702340 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:40.702372 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:40.702485 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:40.702737 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 20:00:40.702937 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":338,"threads_started":1}
I20260807 20:00:40.706946 5101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:40.707739 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:40.708062 5101 log.cc:824] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:40.710803 5101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713: No bootstrap required, opened a new log
I20260807 20:00:40.718688 5104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:40.712475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:44403 (local address 127.0.0.1:46441)
0807 20:00:40.712658 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:40.712664 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:40.712938 (+ 274us) server_negotiation.cc:407] Connection header received
0807 20:00:40.713114 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:40.713120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:40.713183 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:40.713266 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:40.713782 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:40.714555 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:40.716324 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:40.716769 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:40.716885 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:40.717995 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:40.718009 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:40.718013 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:40.718030 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:40.718068 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:40.718082 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:40.718164 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:40.718342 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 20:00:40.718386 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 20:00:40.719900 5101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b3ff3dd614ff68703873814a43713" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46441 } }
I20260807 20:00:40.720238 5101 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:40.720327 5101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c2b3ff3dd614ff68703873814a43713, State: Initialized, Role: FOLLOWER
I20260807 20:00:40.720871 5101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b3ff3dd614ff68703873814a43713" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46441 } }
I20260807 20:00:40.721091 5101 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:40.721216 5101 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:40.721370 5101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:40.723454 5101 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b3ff3dd614ff68703873814a43713" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46441 } }
I20260807 20:00:40.723937 5101 leader_election.cc:302] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c2b3ff3dd614ff68703873814a43713; no voters:
I20260807 20:00:40.724527 5101 leader_election.cc:288] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:40.724623 5112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:40.725606 5112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [term 1 LEADER]: Becoming Leader. State: Replica: 6c2b3ff3dd614ff68703873814a43713, State: Running, Role: LEADER
I20260807 20:00:40.726213 5112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b3ff3dd614ff68703873814a43713" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46441 } }
I20260807 20:00:40.726747 5101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:40.729202 5114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c2b3ff3dd614ff68703873814a43713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b3ff3dd614ff68703873814a43713" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46441 } } }
I20260807 20:00:40.729231 5116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c2b3ff3dd614ff68703873814a43713. Latest consensus state: current_term: 1 leader_uuid: "6c2b3ff3dd614ff68703873814a43713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b3ff3dd614ff68703873814a43713" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46441 } } }
I20260807 20:00:40.729723 5116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:40.730360 5114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:40.730618 5124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:40.736151 5124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:40.745443 5124 catalog_manager.cc:1347] Generated new cluster ID: 5358a4311bbb45aba46090f22bb649b0
I20260807 20:00:40.745553 5124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:40.785001 5124 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:40.786896 5124 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:40.799495 5124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c2b3ff3dd614ff68703873814a43713: Generated new TSK 0
I20260807 20:00:40.800520 5124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:40.821120 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5002
W20260807 20:00:40.822263 5094 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.28:53801
W20260807 20:00:40.822983 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5002: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:40.823133 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5002
W20260807 20:00:40.845496 4983 connection.cc:535] client connection to 127.0.0.1:46441 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46441): Connection reset by peer (error 104)
2026-08-07T20:00:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2096 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:40 dist-test-slave-6bbx krb5kdc[5140](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:40 dist-test-slave-6bbx krb5kdc[5140](info): set up 2 sockets
Aug 07 20:00:40 dist-test-slave-6bbx krb5kdc[5140](info): commencing operation
krb5kdc: starting...
W20260807 20:00:42.030628 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:42 dist-test-slave-6bbx krb5kdc[5140](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:00:42.340760 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44571
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:42.674605 5158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:42.674902 5158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:42.675042 5158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:42.682474 5158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:42.682595 5158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:42.682674 5158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:42.682766 5158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:42.682828 5158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:42.692283 5158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44571
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:42.693490 5158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:42.694752 5158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:42.706169 5164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:42.706087 5167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:42.706116 5165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:42.706969 5158 server_base.cc:1034] running on GCE node
I20260807 20:00:42.707811 5158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:42.709143 5158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:42.710350 5158 hybrid_clock.cc:648] HybridClock initialized: now 1786132842710300 us; error 38 us; skew 500 ppm
I20260807 20:00:42.710685 5158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:42 dist-test-slave-6bbx krb5kdc[5140](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132842, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:42.713759 5158 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:00:42.715103 5158 webserver.cc:460] Webserver started at http://127.0.0.1:35283/ using document root <none> and password file <none>
I20260807 20:00:42.715791 5158 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:42.715924 5158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:42.716213 5158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:42.719070 5158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "8f68360028a845c38ce28ca70222074b"
format_stamp: "Formatted at 2026-08-07 20:00:42 on dist-test-slave-6bbx"
server_key: "4b6043886b40fdf84de30c3947de0dde"
server_key_iv: "697ceb5b8b535bdf8030406cc1ef270d"
server_key_version: "encryptionkey@0"
I20260807 20:00:42.719875 5158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "8f68360028a845c38ce28ca70222074b"
format_stamp: "Formatted at 2026-08-07 20:00:42 on dist-test-slave-6bbx"
server_key: "4b6043886b40fdf84de30c3947de0dde"
server_key_iv: "697ceb5b8b535bdf8030406cc1ef270d"
server_key_version: "encryptionkey@0"
I20260807 20:00:42.724759 5158 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 20:00:42.728006 5180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:42.729203 5158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 20:00:42.729372 5158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "8f68360028a845c38ce28ca70222074b"
format_stamp: "Formatted at 2026-08-07 20:00:42 on dist-test-slave-6bbx"
server_key: "4b6043886b40fdf84de30c3947de0dde"
server_key_iv: "697ceb5b8b535bdf8030406cc1ef270d"
server_key_version: "encryptionkey@0"
I20260807 20:00:42.729553 5158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:42.735200 5158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:42.739185 5158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:42.739475 5158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:42.757097 5158 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44571
I20260807 20:00:42.757143 5250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44571 every 8 connection(s)
I20260807 20:00:42.758496 5158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:42.762261 5251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:42.768187 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5158
I20260807 20:00:42.768383 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:42.768934 5910 external_mini_cluster.cc:1428] Setting key 614a69a2416ad7d267c926136df427f4
I20260807 20:00:42.773231 5251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b: Bootstrap starting.
I20260807 20:00:42.776486 5256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:42.770771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:59397 (local address 127.0.0.1:44571)
0807 20:00:42.771592 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:42.771603 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:42.771644 (+ 41us) server_negotiation.cc:407] Connection header received
0807 20:00:42.773311 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:42.773351 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:42.773681 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:42.773983 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:42.775005 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:42.775011 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:42.775023 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:42.775038 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:42.775101 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:42.775119 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:42.775284 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:42.775391 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 20:00:42.775560 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":363,"threads_started":1}
I20260807 20:00:42.776623 5251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:42.777684 5251 log.cc:824] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:42.780081 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:42.780790 5251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b: No bootstrap required, opened a new log
I20260807 20:00:42.787271 5256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:42.785041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.28:37213 (local address 127.0.0.1:44571)
0807 20:00:42.785174 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:42.785178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:42.785574 (+ 396us) server_negotiation.cc:407] Connection header received
0807 20:00:42.785723 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:42.785727 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:42.785772 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:42.785850 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:42.786698 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:42.786703 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:42.786705 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:42.786720 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:42.786758 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:42.786771 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:42.786866 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:42.786973 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 20:00:42.787021 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 20:00:42.789734 5251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f68360028a845c38ce28ca70222074b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44571 } }
I20260807 20:00:42.790050 5251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:42.790143 5251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f68360028a845c38ce28ca70222074b, State: Initialized, Role: FOLLOWER
I20260807 20:00:42.790663 5251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f68360028a845c38ce28ca70222074b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44571 } }
I20260807 20:00:42.790875 5251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:42.791002 5251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:42.791146 5251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:42.793260 5251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f68360028a845c38ce28ca70222074b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44571 } }
I20260807 20:00:42.793780 5251 leader_election.cc:302] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f68360028a845c38ce28ca70222074b; no voters:
I20260807 20:00:42.794318 5251 leader_election.cc:288] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:42.794433 5266 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:42.795090 5266 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [term 1 LEADER]: Becoming Leader. State: Replica: 8f68360028a845c38ce28ca70222074b, State: Running, Role: LEADER
I20260807 20:00:42.795686 5266 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f68360028a845c38ce28ca70222074b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44571 } }
I20260807 20:00:42.796289 5251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:42.798687 5267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f68360028a845c38ce28ca70222074b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f68360028a845c38ce28ca70222074b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44571 } } }
I20260807 20:00:42.798655 5270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f68360028a845c38ce28ca70222074b. Latest consensus state: current_term: 1 leader_uuid: "8f68360028a845c38ce28ca70222074b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f68360028a845c38ce28ca70222074b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44571 } } }
I20260807 20:00:42.799121 5270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:42.799121 5267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:42.800720 5280 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:42.805424 5280 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:42.813468 5280 catalog_manager.cc:1347] Generated new cluster ID: 0b0475abb5f94c3b8ba64adebc2090e6
I20260807 20:00:42.813575 5280 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:42.823892 5280 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:42.824272 5280 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:42.833675 5280 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f68360028a845c38ce28ca70222074b: Generated new TSK 0
I20260807 20:00:42.834414 5280 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:42.840469 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5158
W20260807 20:00:42.841404 5244 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.28:59397
W20260807 20:00:42.842018 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5158: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:42.842141 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5158
2026-08-07T20:00:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2018 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:42 dist-test-slave-6bbx krb5kdc[5293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:42 dist-test-slave-6bbx krb5kdc[5293](info): set up 2 sockets
Aug 07 20:00:42 dist-test-slave-6bbx krb5kdc[5293](info): commencing operation
krb5kdc: starting...
W20260807 20:00:44.064651 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:44 dist-test-slave-6bbx krb5kdc[5293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:44.383114 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:46657
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:43985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:46657
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:44.720777 5314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:44.721045 5314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:44.721170 5314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:44.728133 5314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:44.728243 5314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:44.728324 5314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:44.728406 5314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:44.728463 5314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:44.738037 5314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:43985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:46657
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:46657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:44.739256 5314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:44.740545 5314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:44.751926 5320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:44.751876 5327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:44.751979 5324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:44.752696 5314 server_base.cc:1034] running on GCE node
I20260807 20:00:44.753448 5314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:44.754745 5314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:44.755930 5314 hybrid_clock.cc:648] HybridClock initialized: now 1786132844755881 us; error 44 us; skew 500 ppm
I20260807 20:00:44.756245 5314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:44 dist-test-slave-6bbx krb5kdc[5293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132844, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:44.759189 5314 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:44.760536 5314 webserver.cc:460] Webserver started at http://127.5.197.190:45589/ using document root <none> and password file <none>
I20260807 20:00:44.761147 5314 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:44.761246 5314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:44.761490 5314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:44.764417 5314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "cdcb3349fd82435eb6f9aeea3f6481b8"
format_stamp: "Formatted at 2026-08-07 20:00:44 on dist-test-slave-6bbx"
server_key: "36695737a5252dc307d7bdd26ededbaa"
server_key_iv: "3eac715e9ea37b61af559e48af79bd86"
server_key_version: "encryptionkey@0"
I20260807 20:00:44.765113 5314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "cdcb3349fd82435eb6f9aeea3f6481b8"
format_stamp: "Formatted at 2026-08-07 20:00:44 on dist-test-slave-6bbx"
server_key: "36695737a5252dc307d7bdd26ededbaa"
server_key_iv: "3eac715e9ea37b61af559e48af79bd86"
server_key_version: "encryptionkey@0"
I20260807 20:00:44.769824 5314 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 20:00:44.773072 5338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:44.774302 5314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 20:00:44.774487 5314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "cdcb3349fd82435eb6f9aeea3f6481b8"
format_stamp: "Formatted at 2026-08-07 20:00:44 on dist-test-slave-6bbx"
server_key: "36695737a5252dc307d7bdd26ededbaa"
server_key_iv: "3eac715e9ea37b61af559e48af79bd86"
server_key_version: "encryptionkey@0"
I20260807 20:00:44.774693 5314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:44.795164 5314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:44.799782 5314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:44.800055 5314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:44.818200 5314 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:46657
I20260807 20:00:44.818249 5409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:46657 every 8 connection(s)
I20260807 20:00:44.819514 5314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:44.823129 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5314
I20260807 20:00:44.823350 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:44.823410 5410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:44.824038 5910 external_mini_cluster.cc:1428] Setting key 1c437d1d8f0f07e92dfd97f844f4f180
I20260807 20:00:44.838270 5410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8: Bootstrap starting.
Aug 07 20:00:44 dist-test-slave-6bbx krb5kdc[5293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:44.842026 5410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:44.843397 5410 log.cc:824] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:44.846768 5410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8: No bootstrap required, opened a new log
I20260807 20:00:44.848316 5413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:44.825816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52795 (local address 127.5.197.190:46657)
0807 20:00:44.826705 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:44.826716 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:44.826760 (+ 44us) server_negotiation.cc:407] Connection header received
0807 20:00:44.828706 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:44.828729 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:44.829118 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:44.829513 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:44.831312 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:44.832673 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:44.834431 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:44.835117 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:44.835252 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:44.839930 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:44.839945 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:44.839967 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:44.840012 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:44.843727 (+ 3715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:44.844645 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:44.844651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:44.844657 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:44.844859 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:44.845308 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:44.845313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:44.845316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:44.845998 (+ 682us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:44.846299 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:44.846692 (+ 393us) server_negotiation.cc:299] Negotiation successful
0807 20:00:44.847011 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":472,"threads_started":1}
I20260807 20:00:44.852451 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:44.856599 5410 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46657 } }
I20260807 20:00:44.857020 5410 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:44.857146 5410 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdcb3349fd82435eb6f9aeea3f6481b8, State: Initialized, Role: FOLLOWER
I20260807 20:00:44.857767 5410 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46657 } }
I20260807 20:00:44.857986 5410 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:44.858117 5410 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:44.858282 5410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:44.860963 5410 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46657 } }
I20260807 20:00:44.861519 5410 leader_election.cc:302] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdcb3349fd82435eb6f9aeea3f6481b8; no voters:
I20260807 20:00:44.862134 5410 leader_election.cc:288] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:44.862250 5422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:44.862816 5422 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [term 1 LEADER]: Becoming Leader. State: Replica: cdcb3349fd82435eb6f9aeea3f6481b8, State: Running, Role: LEADER
I20260807 20:00:44.863457 5422 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46657 } }
I20260807 20:00:44.865341 5410 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:44.866565 5424 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46657 } } }
I20260807 20:00:44.866534 5423 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdcb3349fd82435eb6f9aeea3f6481b8. Latest consensus state: current_term: 1 leader_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdcb3349fd82435eb6f9aeea3f6481b8" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 46657 } } }
I20260807 20:00:44.866994 5424 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:44.867686 5423 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:44.878541 5413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:44.857582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41319 (local address 127.5.197.190:46657)
0807 20:00:44.857770 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:44.857776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:44.858476 (+ 700us) server_negotiation.cc:407] Connection header received
0807 20:00:44.858603 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:44.858608 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:44.858692 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:44.858791 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:44.860196 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:44.861245 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:44.862534 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:44.863212 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:44.863325 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:44.866086 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:44.866092 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:44.866096 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:44.866130 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:44.874170 (+ 8040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:44.875158 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:44.875164 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:44.875168 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:44.875320 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:44.875907 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:44.875912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:44.875916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:44.876351 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:44.876649 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:44.877965 (+ 1316us) server_negotiation.cc:299] Negotiation successful
0807 20:00:44.878152 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 20:00:44.880056 5429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:44.884662 5429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:44.893110 5429 catalog_manager.cc:1347] Generated new cluster ID: b47652511dbc4041bffe24715c1ff3ca
I20260807 20:00:44.893227 5429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:44.914685 5429 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:44.916514 5429 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:44.935417 5429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdcb3349fd82435eb6f9aeea3f6481b8: Generated new TSK 0
I20260807 20:00:44.936348 5429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:44.952936 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5314
I20260807 20:00:44.954077 5405 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:45.045023 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5314
W20260807 20:00:45.067847 5291 connection.cc:535] client connection to 127.5.197.190:46657 recv error: Network error: failed to read from TLS socket (remote: 127.5.197.190:46657): Connection reset by peer (error 104)
2026-08-07T20:00:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2203 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:45 dist-test-slave-6bbx krb5kdc[5453](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:45 dist-test-slave-6bbx krb5kdc[5453](info): set up 2 sockets
Aug 07 20:00:45 dist-test-slave-6bbx krb5kdc[5453](info): commencing operation
krb5kdc: starting...
W20260807 20:00:46.262176 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:46 dist-test-slave-6bbx krb5kdc[5453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:46.592870 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40539
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:40205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:40539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:46.923954 5472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:46.924341 5472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:46.924500 5472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:46.931736 5472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:46.931846 5472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:46.931900 5472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:46.931957 5472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:46.932005 5472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:46.941589 5472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:40205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:40539
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:40539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:46.942788 5472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:46.944139 5472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:46.955444 5481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:46.955356 5478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:46.955497 5477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:46.956441 5472 server_base.cc:1034] running on GCE node
I20260807 20:00:46.957201 5472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:46.958549 5472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:46.959746 5472 hybrid_clock.cc:648] HybridClock initialized: now 1786132846959710 us; error 47 us; skew 500 ppm
I20260807 20:00:46.960085 5472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:46 dist-test-slave-6bbx krb5kdc[5453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132846, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:46.967376 5472 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:46.968843 5472 webserver.cc:460] Webserver started at http://127.5.197.190:37659/ using document root <none> and password file <none>
I20260807 20:00:46.969452 5472 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:46.969550 5472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:46.969796 5472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:46.972705 5472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "33722ba9acfe4985843fe636d1ba8f5a"
format_stamp: "Formatted at 2026-08-07 20:00:46 on dist-test-slave-6bbx"
server_key: "0adf84bb7ec04d6d1630a02c8542f075"
server_key_iv: "bbeaad300e7174e0a8e608f2e289338f"
server_key_version: "encryptionkey@0"
I20260807 20:00:46.973409 5472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "33722ba9acfe4985843fe636d1ba8f5a"
format_stamp: "Formatted at 2026-08-07 20:00:46 on dist-test-slave-6bbx"
server_key: "0adf84bb7ec04d6d1630a02c8542f075"
server_key_iv: "bbeaad300e7174e0a8e608f2e289338f"
server_key_version: "encryptionkey@0"
I20260807 20:00:46.978531 5472 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 20:00:46.981917 5488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:46.983210 5472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:46.983351 5472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "33722ba9acfe4985843fe636d1ba8f5a"
format_stamp: "Formatted at 2026-08-07 20:00:46 on dist-test-slave-6bbx"
server_key: "0adf84bb7ec04d6d1630a02c8542f075"
server_key_iv: "bbeaad300e7174e0a8e608f2e289338f"
server_key_version: "encryptionkey@0"
I20260807 20:00:46.983525 5472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:47.011332 5472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:47.015486 5472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:47.015763 5472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:47.033116 5472 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:40539
I20260807 20:00:47.033154 5556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:40539 every 8 connection(s)
I20260807 20:00:47.034394 5472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:47.038049 5559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:47.041735 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5472
I20260807 20:00:47.041898 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:47.042349 5910 external_mini_cluster.cc:1428] Setting key 20f5ae9154ea67473c1a8a06af68da5f
I20260807 20:00:47.051235 5559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a: Bootstrap starting.
I20260807 20:00:47.054913 5559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:47.056252 5559 log.cc:824] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:47.056787 5563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:47.044073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37595 (local address 127.5.197.190:40539)
0807 20:00:47.044888 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:47.044903 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:47.044962 (+ 59us) server_negotiation.cc:407] Connection header received
0807 20:00:47.046808 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:47.046838 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:47.047359 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:47.047809 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:47.048325 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:47.050346 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:47.051762 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:47.052764 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:47.052967 (+ 203us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:47.054032 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:47.054042 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:47.054060 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:47.054739 (+ 679us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:47.054847 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:47.054880 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:47.055049 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:47.055296 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 20:00:47.055485 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":338,"threads_started":1}
I20260807 20:00:47.059338 5559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a: No bootstrap required, opened a new log
I20260807 20:00:47.060459 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:47.067425 5559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33722ba9acfe4985843fe636d1ba8f5a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40539 } }
I20260807 20:00:47.067842 5559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:47.067932 5559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33722ba9acfe4985843fe636d1ba8f5a, State: Initialized, Role: FOLLOWER
I20260807 20:00:47.068452 5559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33722ba9acfe4985843fe636d1ba8f5a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40539 } }
I20260807 20:00:47.068729 5559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:47.068862 5559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:47.069039 5559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:47.071022 5563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:47.064597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47481 (local address 127.5.197.190:40539)
0807 20:00:47.064771 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:47.064777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:47.065151 (+ 374us) server_negotiation.cc:407] Connection header received
0807 20:00:47.065271 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:47.065276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:47.065350 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:47.065488 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:47.065920 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:47.067012 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:47.068577 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:47.069238 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:47.069377 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:47.070328 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:47.070334 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:47.070339 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:47.070363 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:47.070422 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:47.070442 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:47.070563 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:47.070670 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 20:00:47.070718 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 20:00:47.071698 5559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33722ba9acfe4985843fe636d1ba8f5a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40539 } }
I20260807 20:00:47.072276 5559 leader_election.cc:302] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33722ba9acfe4985843fe636d1ba8f5a; no voters:
I20260807 20:00:47.072892 5559 leader_election.cc:288] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:47.073014 5572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:47.073626 5572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [term 1 LEADER]: Becoming Leader. State: Replica: 33722ba9acfe4985843fe636d1ba8f5a, State: Running, Role: LEADER
I20260807 20:00:47.074164 5572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33722ba9acfe4985843fe636d1ba8f5a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40539 } }
I20260807 20:00:47.075068 5559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:47.081516 5573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33722ba9acfe4985843fe636d1ba8f5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33722ba9acfe4985843fe636d1ba8f5a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40539 } } }
I20260807 20:00:47.083329 5573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:47.084009 5574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33722ba9acfe4985843fe636d1ba8f5a. Latest consensus state: current_term: 1 leader_uuid: "33722ba9acfe4985843fe636d1ba8f5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33722ba9acfe4985843fe636d1ba8f5a" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 40539 } } }
I20260807 20:00:47.084384 5574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:47.092540 5579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:47.097844 5579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:47.106436 5579 catalog_manager.cc:1347] Generated new cluster ID: b96a15cbf7f64da2b6890be63d2e913e
I20260807 20:00:47.106539 5579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:47.127867 5579 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:47.129087 5579 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:47.138460 5579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33722ba9acfe4985843fe636d1ba8f5a: Generated new TSK 0
I20260807 20:00:47.139238 5579 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:47.149293 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5472
W20260807 20:00:47.150382 5550 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37595
W20260807 20:00:47.151196 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5472: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:47.151337 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5472
W20260807 20:00:47.175544 5451 connection.cc:535] client connection to 127.5.197.190:40539 recv error: Network error: failed to read from TLS socket (remote: 127.5.197.190:40539): Connection reset by peer (error 104)
2026-08-07T20:00:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2107 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:47 dist-test-slave-6bbx krb5kdc[5599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:47 dist-test-slave-6bbx krb5kdc[5599](info): set up 2 sockets
Aug 07 20:00:47 dist-test-slave-6bbx krb5kdc[5599](info): commencing operation
krb5kdc: starting...
W20260807 20:00:48.369222 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:48 dist-test-slave-6bbx krb5kdc[5599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:48.700131 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:35485
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:46809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:35485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:49.033825 5619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:49.034101 5619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:49.034242 5619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:49.041373 5619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:49.041486 5619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:49.041563 5619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:49.041656 5619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:49.041713 5619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:49.051385 5619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:46809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:35485
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:35485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:49.052603 5619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:49.053906 5619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:49.065277 5632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:49.065343 5628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:49.065320 5629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:49.066293 5619 server_base.cc:1034] running on GCE node
I20260807 20:00:49.067059 5619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:49.068436 5619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:49.069634 5619 hybrid_clock.cc:648] HybridClock initialized: now 1786132849069587 us; error 40 us; skew 500 ppm
I20260807 20:00:49.069958 5619 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:49 dist-test-slave-6bbx krb5kdc[5599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132849, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:49.073066 5619 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:49.074455 5619 webserver.cc:460] Webserver started at http://127.5.197.190:44485/ using document root <none> and password file <none>
I20260807 20:00:49.075110 5619 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:49.075229 5619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:49.075580 5619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:49.079420 5619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "50f257107e23404dbbaf2f6bb502c294"
format_stamp: "Formatted at 2026-08-07 20:00:49 on dist-test-slave-6bbx"
server_key: "805f06c4741798fe9a3fd144752fcdb4"
server_key_iv: "0aef9e5e346e73df93861791374ea3b9"
server_key_version: "encryptionkey@0"
I20260807 20:00:49.080427 5619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "50f257107e23404dbbaf2f6bb502c294"
format_stamp: "Formatted at 2026-08-07 20:00:49 on dist-test-slave-6bbx"
server_key: "805f06c4741798fe9a3fd144752fcdb4"
server_key_iv: "0aef9e5e346e73df93861791374ea3b9"
server_key_version: "encryptionkey@0"
I20260807 20:00:49.085304 5619 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 20:00:49.088589 5641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:49.089812 5619 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 20:00:49.089952 5619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "50f257107e23404dbbaf2f6bb502c294"
format_stamp: "Formatted at 2026-08-07 20:00:49 on dist-test-slave-6bbx"
server_key: "805f06c4741798fe9a3fd144752fcdb4"
server_key_iv: "0aef9e5e346e73df93861791374ea3b9"
server_key_version: "encryptionkey@0"
I20260807 20:00:49.090111 5619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:49.095430 5619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:49.099274 5619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:49.099512 5619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:49.116317 5619 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:35485
I20260807 20:00:49.116376 5709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:35485 every 8 connection(s)
I20260807 20:00:49.117594 5619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:49.118629 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5619
I20260807 20:00:49.118809 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:49.119225 5910 external_mini_cluster.cc:1428] Setting key aa752cee5e3db2d4b015fb6e5f05e79e
I20260807 20:00:49.121668 5714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:49.127682 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:49.120940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45689 (local address 127.5.197.190:35485)
0807 20:00:49.121754 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:49.121768 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:49.121818 (+ 50us) server_negotiation.cc:407] Connection header received
0807 20:00:49.124053 (+ 2235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:49.124079 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:49.124487 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:49.124906 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:49.125831 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:49.125839 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:49.125855 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:49.125872 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:49.125970 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:49.125996 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:49.126204 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:49.126326 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 20:00:49.126526 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":320,"threads_started":1}
I20260807 20:00:49.130982 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:49.134909 5714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294: Bootstrap starting.
I20260807 20:00:49.138198 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:49.136067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54699 (local address 127.5.197.190:35485)
0807 20:00:49.136226 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:49.136232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:49.136574 (+ 342us) server_negotiation.cc:407] Connection header received
0807 20:00:49.136694 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:49.136699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:49.136758 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:49.136863 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:49.137646 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:49.137651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:49.137655 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:49.137672 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:49.137717 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:49.137735 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:49.137845 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:49.137893 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 20:00:49.137943 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 20:00:49.138438 5714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:49.139741 5714 log.cc:824] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:49.142464 5714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294: No bootstrap required, opened a new log
I20260807 20:00:49.149719 5714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f257107e23404dbbaf2f6bb502c294" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35485 } }
I20260807 20:00:49.150051 5714 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:49.150138 5714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f257107e23404dbbaf2f6bb502c294, State: Initialized, Role: FOLLOWER
I20260807 20:00:49.150648 5714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f257107e23404dbbaf2f6bb502c294" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35485 } }
I20260807 20:00:49.150851 5714 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:49.150985 5714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:49.151139 5714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:49.153422 5714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f257107e23404dbbaf2f6bb502c294" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35485 } }
I20260807 20:00:49.153939 5714 leader_election.cc:302] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50f257107e23404dbbaf2f6bb502c294; no voters:
I20260807 20:00:49.154433 5714 leader_election.cc:288] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:49.154551 5731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:49.155174 5731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [term 1 LEADER]: Becoming Leader. State: Replica: 50f257107e23404dbbaf2f6bb502c294, State: Running, Role: LEADER
I20260807 20:00:49.155699 5731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f257107e23404dbbaf2f6bb502c294" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35485 } }
I20260807 20:00:49.156365 5714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:49.158214 5732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50f257107e23404dbbaf2f6bb502c294" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f257107e23404dbbaf2f6bb502c294" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35485 } } }
I20260807 20:00:49.158641 5732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:49.160890 5733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50f257107e23404dbbaf2f6bb502c294. Latest consensus state: current_term: 1 leader_uuid: "50f257107e23404dbbaf2f6bb502c294" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f257107e23404dbbaf2f6bb502c294" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 35485 } } }
I20260807 20:00:49.161185 5733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:49.162089 5741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:49.167224 5741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:49.174793 5741 catalog_manager.cc:1347] Generated new cluster ID: 47ed9fff8f9e486e8420ed795f450fb2
I20260807 20:00:49.174904 5741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:49.188441 5741 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:49.188903 5741 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:49.196825 5741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50f257107e23404dbbaf2f6bb502c294: Generated new TSK 0
I20260807 20:00:49.197749 5741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:49.209831 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5619
W20260807 20:00:49.210889 5704 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45689
W20260807 20:00:49.211593 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5619: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:49.211751 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5619
2026-08-07T20:00:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2062 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:49 dist-test-slave-6bbx krb5kdc[5764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:49 dist-test-slave-6bbx krb5kdc[5764](info): set up 2 sockets
Aug 07 20:00:49 dist-test-slave-6bbx krb5kdc[5764](info): commencing operation
krb5kdc: starting...
W20260807 20:00:50.443534 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:50 dist-test-slave-6bbx krb5kdc[5764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:50.760938 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:38551
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:33945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:38551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:51.098665 5780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:51.098946 5780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:51.099085 5780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:51.106282 5780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:51.106393 5780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:51.106475 5780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:51.106560 5780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:51.106621 5780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:51.116277 5780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:33945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:38551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:38551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:51.117491 5780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:51.118763 5780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:51.129851 5787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:51.129876 5785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:51.129909 5789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:51.131012 5780 server_base.cc:1034] running on GCE node
I20260807 20:00:51.131723 5780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:51.132977 5780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:51.134158 5780 hybrid_clock.cc:648] HybridClock initialized: now 1786132851134109 us; error 49 us; skew 500 ppm
I20260807 20:00:51.134505 5780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:51 dist-test-slave-6bbx krb5kdc[5764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132851, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:51.137434 5780 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:51.138826 5780 webserver.cc:460] Webserver started at http://127.5.197.190:46295/ using document root <none> and password file <none>
I20260807 20:00:51.139438 5780 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:51.139555 5780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:51.139864 5780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:51.142681 5780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "19349b8b080a4f8a965fa72d2fabc015"
format_stamp: "Formatted at 2026-08-07 20:00:51 on dist-test-slave-6bbx"
server_key: "6180d87e92d16afd759385eb18598224"
server_key_iv: "7187871353a3e037e372a53c0c78ba67"
server_key_version: "encryptionkey@0"
I20260807 20:00:51.143412 5780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "19349b8b080a4f8a965fa72d2fabc015"
format_stamp: "Formatted at 2026-08-07 20:00:51 on dist-test-slave-6bbx"
server_key: "6180d87e92d16afd759385eb18598224"
server_key_iv: "7187871353a3e037e372a53c0c78ba67"
server_key_version: "encryptionkey@0"
I20260807 20:00:51.148216 5780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 20:00:51.151387 5797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:51.152598 5780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 20:00:51.152757 5780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "19349b8b080a4f8a965fa72d2fabc015"
format_stamp: "Formatted at 2026-08-07 20:00:51 on dist-test-slave-6bbx"
server_key: "6180d87e92d16afd759385eb18598224"
server_key_iv: "7187871353a3e037e372a53c0c78ba67"
server_key_version: "encryptionkey@0"
I20260807 20:00:51.152926 5780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:51.192987 5780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:51.196848 5780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:51.197106 5780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:51.214187 5780 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:38551
I20260807 20:00:51.214211 5865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:38551 every 8 connection(s)
I20260807 20:00:51.215516 5780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:51.219239 5867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:51.219458 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5780
I20260807 20:00:51.219643 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:51.220260 5910 external_mini_cluster.cc:1428] Setting key 4baaf254b8fb40d75fb9afc13273a80e
I20260807 20:00:51.233328 5867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015: Bootstrap starting.
Aug 07 20:00:51 dist-test-slave-6bbx krb5kdc[5764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:51.236544 5867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:51.237887 5867 log.cc:824] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:51.241125 5867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015: No bootstrap required, opened a new log
I20260807 20:00:51.244504 5873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:51.222269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46309 (local address 127.5.197.190:38551)
0807 20:00:51.223147 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:51.223163 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:51.223541 (+ 378us) server_negotiation.cc:407] Connection header received
0807 20:00:51.225712 (+ 2171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:51.225742 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:51.226273 (+ 531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:51.226724 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:51.227987 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:51.229950 (+ 1963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:51.231189 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:51.232244 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:51.232419 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:51.236345 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:51.236356 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:51.236376 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:51.236434 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:51.240103 (+ 3669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:51.240758 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:51.240766 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:51.240774 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:51.240994 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:51.241345 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:51.241350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:51.241353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:51.242089 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:51.242390 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:51.242709 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 20:00:51.243166 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":373,"threads_started":1}
I20260807 20:00:51.248138 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:51.250669 5867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19349b8b080a4f8a965fa72d2fabc015" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38551 } }
I20260807 20:00:51.251091 5867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:51.251205 5867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19349b8b080a4f8a965fa72d2fabc015, State: Initialized, Role: FOLLOWER
I20260807 20:00:51.251894 5867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19349b8b080a4f8a965fa72d2fabc015" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38551 } }
I20260807 20:00:51.252187 5867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:51.252333 5867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:51.252518 5867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:51.255107 5867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19349b8b080a4f8a965fa72d2fabc015" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38551 } }
I20260807 20:00:51.255581 5867 leader_election.cc:302] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19349b8b080a4f8a965fa72d2fabc015; no voters:
I20260807 20:00:51.256376 5867 leader_election.cc:288] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:51.256458 5880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:51.257071 5880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [term 1 LEADER]: Becoming Leader. State: Replica: 19349b8b080a4f8a965fa72d2fabc015, State: Running, Role: LEADER
I20260807 20:00:51.257654 5880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19349b8b080a4f8a965fa72d2fabc015" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38551 } }
I20260807 20:00:51.259265 5880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19349b8b080a4f8a965fa72d2fabc015. Latest consensus state: current_term: 1 leader_uuid: "19349b8b080a4f8a965fa72d2fabc015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19349b8b080a4f8a965fa72d2fabc015" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38551 } } }
I20260807 20:00:51.259536 5880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:51.263314 5883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19349b8b080a4f8a965fa72d2fabc015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19349b8b080a4f8a965fa72d2fabc015" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 38551 } } }
I20260807 20:00:51.264462 5883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:51.267952 5867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:51.268890 5887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:51.275166 5873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:51.253452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38551 (local address 127.5.197.190:38551)
0807 20:00:51.253638 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:51.253643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:51.254035 (+ 392us) server_negotiation.cc:407] Connection header received
0807 20:00:51.254167 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:51.254172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:51.254250 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:51.254350 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:51.255855 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:51.257149 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:51.259116 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:51.263957 (+ 4841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:51.264173 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:51.268215 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:51.268222 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:51.268226 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:51.268262 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:51.272149 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:51.272994 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:51.273000 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:51.273004 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:51.273149 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:51.273534 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:51.273538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:51.273542 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:51.273930 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:51.274181 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:51.274543 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 20:00:51.274771 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 20:00:51.279421 5887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:51.289317 5887 catalog_manager.cc:1347] Generated new cluster ID: 3c15f5bb2b5348c4854e1308d4440952
I20260807 20:00:51.289721 5887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:51.347891 5887 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:51.349850 5887 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:51.364816 5887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19349b8b080a4f8a965fa72d2fabc015: Generated new TSK 0
I20260807 20:00:51.365866 5887 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:51.384888 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5780
I20260807 20:00:51.386022 5860 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:00:51.481791 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5780
2026-08-07T20:00:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2264 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:51 dist-test-slave-6bbx krb5kdc[5916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:51 dist-test-slave-6bbx krb5kdc[5916](info): set up 2 sockets
Aug 07 20:00:51 dist-test-slave-6bbx krb5kdc[5916](info): commencing operation
krb5kdc: starting...
W20260807 20:00:52.699411 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:52 dist-test-slave-6bbx krb5kdc[5916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:53.014925 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33067
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:35231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:33067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:53.352375 5933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:53.352669 5933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:53.352805 5933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:53.359961 5933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:53.360076 5933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:53.360128 5933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:53.360292 5933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:53.360363 5933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:53.370103 5933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:35231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:33067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:53.371393 5933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:53.372750 5933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:53.384449 5942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:53.384493 5941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:53.384398 5946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:53.385388 5933 server_base.cc:1034] running on GCE node
I20260807 20:00:53.386149 5933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:53.387492 5933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:53.388692 5933 hybrid_clock.cc:648] HybridClock initialized: now 1786132853388640 us; error 41 us; skew 500 ppm
I20260807 20:00:53.389047 5933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:53 dist-test-slave-6bbx krb5kdc[5916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132853, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:53.395397 5933 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:53.396942 5933 webserver.cc:460] Webserver started at http://127.5.197.190:44325/ using document root <none> and password file <none>
I20260807 20:00:53.397639 5933 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:53.397758 5933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:53.398051 5933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:53.401141 5933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "7dbbbcd36e294008b9338386660c069e"
format_stamp: "Formatted at 2026-08-07 20:00:53 on dist-test-slave-6bbx"
server_key: "b4fad31a498ed63c5e0a1998febfadb2"
server_key_iv: "22ed2111d2489788d91c88da591da05e"
server_key_version: "encryptionkey@0"
I20260807 20:00:53.401887 5933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "7dbbbcd36e294008b9338386660c069e"
format_stamp: "Formatted at 2026-08-07 20:00:53 on dist-test-slave-6bbx"
server_key: "b4fad31a498ed63c5e0a1998febfadb2"
server_key_iv: "22ed2111d2489788d91c88da591da05e"
server_key_version: "encryptionkey@0"
I20260807 20:00:53.406913 5933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 20:00:53.410310 5957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:53.411602 5933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 20:00:53.411793 5933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "7dbbbcd36e294008b9338386660c069e"
format_stamp: "Formatted at 2026-08-07 20:00:53 on dist-test-slave-6bbx"
server_key: "b4fad31a498ed63c5e0a1998febfadb2"
server_key_iv: "22ed2111d2489788d91c88da591da05e"
server_key_version: "encryptionkey@0"
I20260807 20:00:53.411970 5933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:53.431538 5933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:53.435779 5933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:53.436053 5933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:53.454202 5933 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:33067
I20260807 20:00:53.454259 6028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:33067 every 8 connection(s)
I20260807 20:00:53.455595 5933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:53.459403 6029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:53.464496 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 5933
I20260807 20:00:53.464695 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:53.465251 5910 external_mini_cluster.cc:1428] Setting key 9ed0f93063a4fc16742033b2d4958798
I20260807 20:00:53.471081 6029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e: Bootstrap starting.
I20260807 20:00:53.474687 6029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:53.476004 6029 log.cc:824] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:53.478772 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:53.467010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55687 (local address 127.5.197.190:33067)
0807 20:00:53.467787 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:53.467802 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:53.467844 (+ 42us) server_negotiation.cc:407] Connection header received
0807 20:00:53.469583 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:53.469606 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:53.469980 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:53.470271 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:53.470847 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:53.472230 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:53.474066 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:53.474718 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:53.474902 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:53.476071 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:53.476079 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:53.476093 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:53.476752 (+ 659us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:53.476848 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:53.476904 (+ 56us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:53.477024 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:53.477239 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 20:00:53.477500 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":356,"threads_started":1}
I20260807 20:00:53.479327 6029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e: No bootstrap required, opened a new log
I20260807 20:00:53.482496 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:53.487287 6029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dbbbcd36e294008b9338386660c069e" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33067 } }
I20260807 20:00:53.487807 6029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:53.487938 6029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbbcd36e294008b9338386660c069e, State: Initialized, Role: FOLLOWER
I20260807 20:00:53.488646 6029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dbbbcd36e294008b9338386660c069e" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33067 } }
I20260807 20:00:53.488894 6029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:53.489037 6029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:53.489202 6029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:53.492291 6029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dbbbcd36e294008b9338386660c069e" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33067 } }
I20260807 20:00:53.492910 6029 leader_election.cc:302] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dbbbcd36e294008b9338386660c069e; no voters:
I20260807 20:00:53.493628 6029 leader_election.cc:288] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:53.493736 6041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:53.494021 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:53.486845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47859 (local address 127.5.197.190:33067)
0807 20:00:53.487067 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:53.487074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:53.487484 (+ 410us) server_negotiation.cc:407] Connection header received
0807 20:00:53.487751 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:53.487757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:53.487843 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:53.487940 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:53.488531 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:53.489410 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:53.491259 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:53.491807 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:53.491916 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:53.493100 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:53.493107 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:53.493112 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:53.493136 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:53.493176 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:53.493193 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:53.493266 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:53.493465 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 20:00:53.493570 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 20:00:53.496058 6029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:53.497994 6041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [term 1 LEADER]: Becoming Leader. State: Replica: 7dbbbcd36e294008b9338386660c069e, State: Running, Role: LEADER
I20260807 20:00:53.498751 6041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dbbbcd36e294008b9338386660c069e" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33067 } }
I20260807 20:00:53.502233 6044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dbbbcd36e294008b9338386660c069e. Latest consensus state: current_term: 1 leader_uuid: "7dbbbcd36e294008b9338386660c069e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dbbbcd36e294008b9338386660c069e" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33067 } } }
I20260807 20:00:53.502310 6043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7dbbbcd36e294008b9338386660c069e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dbbbcd36e294008b9338386660c069e" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33067 } } }
I20260807 20:00:53.502648 6044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:53.502681 6043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:53.508229 6061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:53.513365 6061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:53.522784 6061 catalog_manager.cc:1347] Generated new cluster ID: 375e012ea31b4528912976b53a335122
I20260807 20:00:53.522933 6061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:53.534446 6061 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:53.535908 6061 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:53.548976 6061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7dbbbcd36e294008b9338386660c069e: Generated new TSK 0
I20260807 20:00:53.549849 6061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:53.559728 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5933
W20260807 20:00:53.560899 6018 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55687
W20260807 20:00:53.561599 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 5933: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:53.561733 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 5933
2026-08-07T20:00:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2082 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:53 dist-test-slave-6bbx krb5kdc[6068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:53 dist-test-slave-6bbx krb5kdc[6068](info): set up 2 sockets
Aug 07 20:00:53 dist-test-slave-6bbx krb5kdc[6068](info): commencing operation
krb5kdc: starting...
W20260807 20:00:54.778177 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.004s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:54 dist-test-slave-6bbx krb5kdc[6068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:55.096318 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33569
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:32909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:33569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:55.431068 6085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:55.431334 6085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:55.431473 6085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:55.438426 6085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:55.438527 6085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:55.438604 6085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:55.438680 6085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:55.438735 6085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:55.448069 6085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:32909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:33569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:33569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:55.449275 6085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:55.450526 6085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:55.461886 6095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:55.461951 6093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:55.462057 6092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:55.462670 6085 server_base.cc:1034] running on GCE node
I20260807 20:00:55.463413 6085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:55.464759 6085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:55.465953 6085 hybrid_clock.cc:648] HybridClock initialized: now 1786132855465897 us; error 48 us; skew 500 ppm
I20260807 20:00:55.466284 6085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:55 dist-test-slave-6bbx krb5kdc[6068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132855, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:55.469333 6085 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:55.470706 6085 webserver.cc:460] Webserver started at http://127.5.197.190:42297/ using document root <none> and password file <none>
I20260807 20:00:55.471345 6085 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:55.471459 6085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:55.471796 6085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:55.474705 6085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "2d58fd02fb1d471db128d5c8f5af3212"
format_stamp: "Formatted at 2026-08-07 20:00:55 on dist-test-slave-6bbx"
server_key: "7d7998b18a6e4508b09b04d7735a8770"
server_key_iv: "7dbaeea36f067aa05ed0625b30905cb9"
server_key_version: "encryptionkey@0"
I20260807 20:00:55.475457 6085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "2d58fd02fb1d471db128d5c8f5af3212"
format_stamp: "Formatted at 2026-08-07 20:00:55 on dist-test-slave-6bbx"
server_key: "7d7998b18a6e4508b09b04d7735a8770"
server_key_iv: "7dbaeea36f067aa05ed0625b30905cb9"
server_key_version: "encryptionkey@0"
I20260807 20:00:55.480404 6085 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260807 20:00:55.483716 6104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:55.484948 6085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 20:00:55.485154 6085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "2d58fd02fb1d471db128d5c8f5af3212"
format_stamp: "Formatted at 2026-08-07 20:00:55 on dist-test-slave-6bbx"
server_key: "7d7998b18a6e4508b09b04d7735a8770"
server_key_iv: "7dbaeea36f067aa05ed0625b30905cb9"
server_key_version: "encryptionkey@0"
I20260807 20:00:55.485335 6085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:55.490572 6085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:55.494534 6085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:55.494771 6085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:55.511548 6085 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:33569
I20260807 20:00:55.511577 6178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:33569 every 8 connection(s)
I20260807 20:00:55.512850 6085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:55.516498 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6085
I20260807 20:00:55.516605 6179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:55.516695 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:55.517237 5910 external_mini_cluster.cc:1428] Setting key 5753b29ba0446f229ab12efd5970ad5a
I20260807 20:00:55.524792 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:55.518959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43685 (local address 127.5.197.190:33569)
0807 20:00:55.519825 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:55.519839 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:55.519885 (+ 46us) server_negotiation.cc:407] Connection header received
0807 20:00:55.521442 (+ 1557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:55.521463 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:55.521778 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:55.522095 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:55.523094 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:55.523099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:55.523111 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:55.523131 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:55.523192 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:55.523213 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:55.523386 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:55.523498 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 20:00:55.523695 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":374,"threads_started":1}
I20260807 20:00:55.528146 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:55.529683 6179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212: Bootstrap starting.
I20260807 20:00:55.532733 6179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:55.533993 6179 log.cc:824] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:55.534760 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:55.532263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50855 (local address 127.5.197.190:33569)
0807 20:00:55.532422 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:55.532428 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:55.532945 (+ 517us) server_negotiation.cc:407] Connection header received
0807 20:00:55.533110 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:55.533114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:55.533160 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:55.533242 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:55.534143 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:55.534148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:55.534151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:00:55.534165 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:55.534200 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:00:55.534214 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:55.534293 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:55.534418 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 20:00:55.534469 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 20:00:55.536860 6179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212: No bootstrap required, opened a new log
I20260807 20:00:55.543984 6179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d58fd02fb1d471db128d5c8f5af3212" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33569 } }
I20260807 20:00:55.544312 6179 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:00:55.544391 6179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d58fd02fb1d471db128d5c8f5af3212, State: Initialized, Role: FOLLOWER
I20260807 20:00:55.544898 6179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d58fd02fb1d471db128d5c8f5af3212" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33569 } }
I20260807 20:00:55.545096 6179 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:00:55.545194 6179 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:00:55.545312 6179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:55.547307 6179 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d58fd02fb1d471db128d5c8f5af3212" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33569 } }
I20260807 20:00:55.547843 6179 leader_election.cc:302] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d58fd02fb1d471db128d5c8f5af3212; no voters:
I20260807 20:00:55.548406 6179 leader_election.cc:288] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:00:55.548523 6189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:55.549136 6189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [term 1 LEADER]: Becoming Leader. State: Replica: 2d58fd02fb1d471db128d5c8f5af3212, State: Running, Role: LEADER
I20260807 20:00:55.549654 6189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d58fd02fb1d471db128d5c8f5af3212" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33569 } }
I20260807 20:00:55.550307 6179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:55.552186 6191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d58fd02fb1d471db128d5c8f5af3212. Latest consensus state: current_term: 1 leader_uuid: "2d58fd02fb1d471db128d5c8f5af3212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d58fd02fb1d471db128d5c8f5af3212" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33569 } } }
I20260807 20:00:55.552395 6190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d58fd02fb1d471db128d5c8f5af3212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d58fd02fb1d471db128d5c8f5af3212" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 33569 } } }
I20260807 20:00:55.552644 6191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:55.552691 6190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:55.555023 6194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:55.560622 6194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:55.569494 6194 catalog_manager.cc:1347] Generated new cluster ID: 19f8f377363e4fbb9fa138b5c7f64d99
I20260807 20:00:55.569607 6194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:55.583544 6194 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:55.584005 6194 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:55.595129 6194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d58fd02fb1d471db128d5c8f5af3212: Generated new TSK 0
I20260807 20:00:55.595908 6194 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:55.607398 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6085
W20260807 20:00:55.608449 6173 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43685
W20260807 20:00:55.609042 5910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6085: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 20:00:55.609187 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6085
2026-08-07T20:00:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2046 ms)
[----------] 18 tests from AuthTokenIssuingTest (37889 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:00:55 dist-test-slave-6bbx krb5kdc[6220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:00:55 dist-test-slave-6bbx krb5kdc[6220](info): set up 2 sockets
Aug 07 20:00:55 dist-test-slave-6bbx krb5kdc[6220](info): commencing operation
krb5kdc: starting...
W20260807 20:00:56.811069 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:00:57 dist-test-slave-6bbx krb5kdc[6220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:00:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:00:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:00:57.127202 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43919
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:43919,127.5.197.189:42713,127.5.197.188:46025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:00:57.462085 6235 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:00:57.462452 6235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:57.462551 6235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:57.462664 6235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:57.469612 6235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:57.469702 6235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:57.469785 6235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:57.469849 6235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:57.469933 6235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:57.479343 6235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:43919,127.5.197.189:42713,127.5.197.188:46025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:43919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:57.480613 6235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:57.481885 6235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:57.493163 6242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:57.493193 6243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:57.493470 6245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:57.493994 6235 server_base.cc:1034] running on GCE node
I20260807 20:00:57.494697 6235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:57.496016 6235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:57.497232 6235 hybrid_clock.cc:648] HybridClock initialized: now 1786132857497175 us; error 26 us; skew 500 ppm
I20260807 20:00:57.497532 6235 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:57 dist-test-slave-6bbx krb5kdc[6220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:57.500471 6235 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:00:57.501785 6235 webserver.cc:460] Webserver started at http://127.5.197.190:36579/ using document root <none> and password file <none>
I20260807 20:00:57.502462 6235 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:57.502562 6235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:57.502864 6235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:57.505738 6235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "7c9d481290204177a465dddba75f7c57"
format_stamp: "Formatted at 2026-08-07 20:00:57 on dist-test-slave-6bbx"
server_key: "d783445704a365a0481cc8c94794e110"
server_key_iv: "83192855a421bc8a73c8b5c9deeccf70"
server_key_version: "encryptionkey@0"
I20260807 20:00:57.506510 6235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "7c9d481290204177a465dddba75f7c57"
format_stamp: "Formatted at 2026-08-07 20:00:57 on dist-test-slave-6bbx"
server_key: "d783445704a365a0481cc8c94794e110"
server_key_iv: "83192855a421bc8a73c8b5c9deeccf70"
server_key_version: "encryptionkey@0"
I20260807 20:00:57.511590 6235 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260807 20:00:57.514817 6256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:57.516115 6235 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 20:00:57.516274 6235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "7c9d481290204177a465dddba75f7c57"
format_stamp: "Formatted at 2026-08-07 20:00:57 on dist-test-slave-6bbx"
server_key: "d783445704a365a0481cc8c94794e110"
server_key_iv: "83192855a421bc8a73c8b5c9deeccf70"
server_key_version: "encryptionkey@0"
I20260807 20:00:57.516464 6235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:57.553774 6235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:57.557747 6235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:57.558053 6235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:57.575748 6235 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:43919
I20260807 20:00:57.575769 6324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:43919 every 8 connection(s)
I20260807 20:00:57.577054 6235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:00:57.580650 6326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:57.584295 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6235
I20260807 20:00:57.584487 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:00:57.585119 5910 external_mini_cluster.cc:1428] Setting key fda96e7d2e894f8a6236e2e36dbecb3a
I20260807 20:00:57.587489 6326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:00:57 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:57.609225 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.590436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43919 (local address 127.0.0.1:38674)
0807 20:00:57.591204 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.591251 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:57.593265 (+ 2014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:57.594209 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:57.594215 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:57.594735 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:57.595072 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:57.595088 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:57.597092 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:57.597096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:57.598150 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:57.598163 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:57.599249 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:57.599254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:57.599403 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:57.600016 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:57.600038 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:57.602536 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:57.605444 (+ 2908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:57.605456 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:57.605466 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:57.605944 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:57.606331 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:57.606335 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:57.606339 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:57.606573 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:57.607257 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:57.607264 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:57.607488 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 20:00:57.607831 (+ 343us) client_negotiation.cc:240] Negotiation successful
0807 20:00:57.608333 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":74,"thread_start_us":291,"threads_started":1}
I20260807 20:00:57.609282 6333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.591602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38674 (local address 127.5.197.190:43919)
0807 20:00:57.592341 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:57.592352 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:57.592403 (+ 51us) server_negotiation.cc:407] Connection header received
0807 20:00:57.593619 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:57.593626 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:57.593900 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:57.594117 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:57.595280 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:57.596937 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:57.598293 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:57.599046 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:57.599210 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:57.602741 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:57.602748 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:57.602759 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:57.602793 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:57.605318 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:57.606064 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:57.606070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:57.606072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:57.606216 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:57.606675 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:57.606678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:57.606680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:57.607123 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:57.607270 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:57.607931 (+ 661us) server_negotiation.cc:299] Negotiation successful
0807 20:00:57.608176 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":349,"threads_started":1}
I20260807 20:00:57.612412 6326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:00:57.613442 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.613091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:56588)
0807 20:00:57.613233 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.613331 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 20:00:57.613812 6262 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
I20260807 20:00:57.615228 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.614927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:56604)
0807 20:00:57.615054 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.615116 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 20:00:57.615424 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:42713: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.5.197.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab.
Entry for principal kudu/127.5.197.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab.
I20260807 20:00:57.658385 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:42713
--webserver_interface=127.5.197.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab
--principal=kudu/127.5.197.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:43919,127.5.197.189:42713,127.5.197.188:46025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:00:57.664722 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } attempt: 1
I20260807 20:00:57.665895 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.665458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:56606)
0807 20:00:57.665645 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.665757 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 20:00:57.666833 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.666497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:56614)
0807 20:00:57.666640 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.666706 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 20:00:57.667021 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:42713: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
I20260807 20:00:57.735292 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } attempt: 2
I20260807 20:00:57.736613 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.736022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50642)
0807 20:00:57.736304 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.736422 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 20:00:57.737675 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.737225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50656)
0807 20:00:57.737390 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.737493 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 20:00:57.737865 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:42713: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
I20260807 20:00:57.829138 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } attempt: 3
I20260807 20:00:57.830370 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.829844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50664)
0807 20:00:57.830072 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.830194 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 20:00:57.831354 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.830955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50680)
0807 20:00:57.831107 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.831191 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 20:00:57.831542 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:42713: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
I20260807 20:00:57.974813 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } attempt: 4
I20260807 20:00:57.976248 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.975544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50682)
0807 20:00:57.975967 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.976076 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223}
I20260807 20:00:57.977304 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:57.976897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50690)
0807 20:00:57.977061 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:57.977160 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 20:00:57.977543 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:42713: Network error: Client connection negotiation failed: client connection to 127.5.197.189:42713: connect: Connection refused (error 111)
W20260807 20:00:57.994783 6338 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:00:57.995096 6338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:57.995185 6338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:57.995291 6338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:00:58.002547 6338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:58.002625 6338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:58.002720 6338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:58.002780 6338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:58.002868 6338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:58.012540 6338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:43919,127.5.197.189:42713,127.5.197.188:46025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab
--principal=kudu/127.5.197.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:42713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.197.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:58.013790 6338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:58.015089 6338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:58.026330 6347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:58.026399 6350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:58.026420 6348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:58.027069 6338 server_base.cc:1034] running on GCE node
I20260807 20:00:58.027844 6338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:58.029099 6338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:58.030309 6338 hybrid_clock.cc:648] HybridClock initialized: now 1786132858030242 us; error 43 us; skew 500 ppm
I20260807 20:00:58.030625 6338 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:58.033643 6338 init.cc:377] Logged in from keytab as kudu/127.5.197.189@KRBTEST.COM (short username kudu)
I20260807 20:00:58.035007 6338 webserver.cc:460] Webserver started at http://127.5.197.189:41437/ using document root <none> and password file <none>
I20260807 20:00:58.035660 6338 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:58.035799 6338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:58.036123 6338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:58.038971 6338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data/instance:
uuid: "ad54d22194df499c89c57977a5dbdca9"
format_stamp: "Formatted at 2026-08-07 20:00:58 on dist-test-slave-6bbx"
server_key: "097c986402dbe6aef1b3b8aa48a17479"
server_key_iv: "0204341c9479362e29332ab47369f869"
server_key_version: "encryptionkey@0"
I20260807 20:00:58.039757 6338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/wal/instance:
uuid: "ad54d22194df499c89c57977a5dbdca9"
format_stamp: "Formatted at 2026-08-07 20:00:58 on dist-test-slave-6bbx"
server_key: "097c986402dbe6aef1b3b8aa48a17479"
server_key_iv: "0204341c9479362e29332ab47369f869"
server_key_version: "encryptionkey@0"
I20260807 20:00:58.044708 6338 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 20:00:58.047969 6358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:58.049254 6338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 20:00:58.049423 6338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/wal
uuid: "ad54d22194df499c89c57977a5dbdca9"
format_stamp: "Formatted at 2026-08-07 20:00:58 on dist-test-slave-6bbx"
server_key: "097c986402dbe6aef1b3b8aa48a17479"
server_key_iv: "0204341c9479362e29332ab47369f869"
server_key_version: "encryptionkey@0"
I20260807 20:00:58.049615 6338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:58.064286 6338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:58.068424 6338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:58.068699 6338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:58.086067 6338 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.189:42713
I20260807 20:00:58.086086 6425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.189:42713 every 8 connection(s)
I20260807 20:00:58.087366 6338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
I20260807 20:00:58.091096 6426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:58.097493 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6338
I20260807 20:00:58.097681 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-1/wal/instance
I20260807 20:00:58.098207 5910 external_mini_cluster.cc:1428] Setting key 2356b24e28f1cc84db999280628b5e53
I20260807 20:00:58.097577 6426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:58.119306 6333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.100735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45564 (local address 127.5.197.190:43919)
0807 20:00:58.100951 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.100957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.102005 (+ 1048us) server_negotiation.cc:407] Connection header received
0807 20:00:58.104307 (+ 2302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.104312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.104389 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.104473 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.106245 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.106921 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.108893 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.109294 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.109397 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.113214 (+ 3817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.113220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.113223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.113257 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.116403 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.117096 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.117101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.117104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.117250 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.117622 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.117627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.117630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.118002 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.118143 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.118746 (+ 603us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.119010 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 20:00:58.120057 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.101040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43919 (local address 127.0.0.1:45564)
0807 20:00:58.101803 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.101874 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.104041 (+ 2167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.104715 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.104725 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.105384 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.106103 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.106126 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.107072 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.107076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.108741 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.108755 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.109524 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.109530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.109780 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.110440 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.110465 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.113000 (+ 2535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.116528 (+ 3528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.116534 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.116544 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.116966 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.117340 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.117343 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.117346 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.117495 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.118109 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.118114 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.118392 (+ 278us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.118599 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.118951 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":298,"threads_started":1}
I20260807 20:00:58.121737 6426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.197.188@KRBTEST.COM; defaulting to no policy
I20260807 20:00:58.135267 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.122463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50692)
0807 20:00:58.122616 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.122631 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.122706 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.123725 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.123729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.124123 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.124240 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.124248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.125555 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.125558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.126361 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.126373 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.127110 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.127116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.127288 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.127776 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.127793 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.130048 (+ 2255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.133046 (+ 2998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.133049 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.133052 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.133398 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.133774 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.133777 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.133779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.133943 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.134470 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.134473 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.134608 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.134746 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.134949 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.188@KRBTEST.COM" created.
I20260807 20:00:58.135416 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.122710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50692 (local address 127.5.197.189:42713)
0807 20:00:58.123336 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.123341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.123372 (+ 31us) server_negotiation.cc:407] Connection header received
0807 20:00:58.123412 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.123417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.123567 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.123718 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.124402 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.125430 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.126485 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.126983 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.127088 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.130244 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.130255 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.130267 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.130295 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.132928 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.133540 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.133548 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.133551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.133684 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.134029 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.134033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.134035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.134354 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.134521 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.134870 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.135053 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":362,"threads_started":1}
I20260807 20:00:58.137848 6426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:00:58.139005 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.138564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:51990)
0807 20:00:58.138758 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.138869 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 20:00:58.139305 6363 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.140744 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.140444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:51992)
0807 20:00:58.140566 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.140642 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 20:00:58.140955 6426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab.
Entry for principal kudu/127.5.197.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab.
I20260807 20:00:58.172122 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:46025
--webserver_interface=127.5.197.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab
--principal=kudu/127.5.197.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:43919,127.5.197.189:42713,127.5.197.188:46025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:00:58.190274 6426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 1
I20260807 20:00:58.191562 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.191077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52008)
0807 20:00:58.191282 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.191398 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 20:00:58.192642 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.192297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52024)
0807 20:00:58.192457 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.192535 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 20:00:58.192847 6426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.261061 6426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 2
I20260807 20:00:58.262199 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.261753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52026)
0807 20:00:58.261937 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.262029 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 20:00:58.263226 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.262911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52034)
0807 20:00:58.263046 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.263115 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 20:00:58.263434 6426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.276782 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } attempt: 5
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 20:00:58.289659 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.277615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50696 (local address 127.5.197.189:42713)
0807 20:00:58.277789 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.277795 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.277811 (+ 16us) server_negotiation.cc:407] Connection header received
0807 20:00:58.277866 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.277869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.277942 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.278024 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.278821 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.279513 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.280672 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.281124 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.281238 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.284671 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.284675 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.284679 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.284711 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.287089 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.287881 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.287885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.287887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.288002 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.288386 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.288389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.288391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.288703 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.288850 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.289267 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.289453 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 20:00:58.289790 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.277401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50696)
0807 20:00:58.277577 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.277593 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.277709 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.278092 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.278098 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.278483 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.278678 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.278687 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.279646 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.279651 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.280526 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.280539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.281268 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.281274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.281492 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.282117 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.282134 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.284491 (+ 2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.287224 (+ 2733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.287229 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.287233 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.287776 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.288098 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.288102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.288106 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.288286 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.288831 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.288837 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.289012 (+ 175us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.289171 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.289445 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 20:00:58.290972 6326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:00:58.292073 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.291735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52044)
0807 20:00:58.291880 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.291948 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 20:00:58.292905 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.292608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52052)
0807 20:00:58.292747 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.292809 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 20:00:58.293087 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.344300 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 1
I20260807 20:00:58.345393 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.344928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52068)
0807 20:00:58.345119 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.345220 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 20:00:58.346371 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.346007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52070)
0807 20:00:58.346150 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.346263 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 20:00:58.346570 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.354626 6426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 3
I20260807 20:00:58.355592 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.355168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52086)
0807 20:00:58.355344 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.355438 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 20:00:58.356599 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.356194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52100)
0807 20:00:58.356418 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.356493 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260807 20:00:58.356807 6426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.414768 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 2
I20260807 20:00:58.415963 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.415462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52108)
0807 20:00:58.415705 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.415798 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 20:00:58.416846 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.416530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52120)
0807 20:00:58.416668 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.416747 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 20:00:58.417042 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.500000 6426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 4
I20260807 20:00:58.501051 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.500578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52124)
0807 20:00:58.500801 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.500888 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 20:00:58.502032 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.501720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52140)
0807 20:00:58.501859 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.501928 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 20:00:58.502252 6426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
W20260807 20:00:58.516390 6435 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:00:58.516705 6435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:00:58.516806 6435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:00:58.516916 6435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 20:00:58.523223 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 3
I20260807 20:00:58.524257 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.523831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52150)
0807 20:00:58.524024 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.524105 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 20:00:58.524312 6435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:00:58.524423 6435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:00:58.524521 6435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:00:58.524593 6435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:00:58.524684 6435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:00:58.525224 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.524876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52162)
0807 20:00:58.525057 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.525128 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260807 20:00:58.525409 6326 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:46025: Network error: Client connection negotiation failed: client connection to 127.5.197.188:46025: connect: Connection refused (error 111)
I20260807 20:00:58.534654 6435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:43919,127.5.197.189:42713,127.5.197.188:46025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab
--principal=kudu/127.5.197.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:46025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.197.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:00:58.535951 6435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:00:58.537253 6435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:00:58.548810 6441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:58.548847 6444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:00:58.549016 6442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:00:58.549932 6435 server_base.cc:1034] running on GCE node
I20260807 20:00:58.550699 6435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:00:58.552102 6435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:00:58.553308 6435 hybrid_clock.cc:648] HybridClock initialized: now 1786132858553230 us; error 48 us; skew 500 ppm
I20260807 20:00:58.553630 6435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:00:58.559883 6435 init.cc:377] Logged in from keytab as kudu/127.5.197.188@KRBTEST.COM (short username kudu)
I20260807 20:00:58.561640 6435 webserver.cc:460] Webserver started at http://127.5.197.188:45303/ using document root <none> and password file <none>
I20260807 20:00:58.562546 6435 fs_manager.cc:359] Metadata directory not provided
I20260807 20:00:58.562675 6435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:00:58.563045 6435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:00:58.566084 6435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data/instance:
uuid: "3c3745bc3daf460ca1e698de8a4633a9"
format_stamp: "Formatted at 2026-08-07 20:00:58 on dist-test-slave-6bbx"
server_key: "5de7ad86a1378179ed48713f3f3ea067"
server_key_iv: "37337a8b6170c863ede878381417ebea"
server_key_version: "encryptionkey@0"
I20260807 20:00:58.566869 6435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/wal/instance:
uuid: "3c3745bc3daf460ca1e698de8a4633a9"
format_stamp: "Formatted at 2026-08-07 20:00:58 on dist-test-slave-6bbx"
server_key: "5de7ad86a1378179ed48713f3f3ea067"
server_key_iv: "37337a8b6170c863ede878381417ebea"
server_key_version: "encryptionkey@0"
I20260807 20:00:58.572007 6435 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 20:00:58.575476 6453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:00:58.576875 6435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 20:00:58.577035 6435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/wal
uuid: "3c3745bc3daf460ca1e698de8a4633a9"
format_stamp: "Formatted at 2026-08-07 20:00:58 on dist-test-slave-6bbx"
server_key: "5de7ad86a1378179ed48713f3f3ea067"
server_key_iv: "37337a8b6170c863ede878381417ebea"
server_key_version: "encryptionkey@0"
I20260807 20:00:58.577229 6435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:00:58.588912 6435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:00:58.592963 6435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:00:58.593218 6435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:00:58.610507 6435 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.188:46025
I20260807 20:00:58.610512 6519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.188:46025 every 8 connection(s)
I20260807 20:00:58.611790 6435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
I20260807 20:00:58.614943 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6435
I20260807 20:00:58.615137 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132491354022-5910-0/minicluster-data/master-2/wal/instance
I20260807 20:00:58.615483 6520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:00:58.615768 5910 external_mini_cluster.cc:1428] Setting key 77cd87ac8b1dab53c7625b1515148a4d
I20260807 20:00:58.624915 6520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:00:58.637645 6524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.617531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52164 (local address 127.5.197.188:46025)
0807 20:00:58.618308 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.618322 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.618375 (+ 53us) server_negotiation.cc:407] Connection header received
0807 20:00:58.620133 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.620155 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.620517 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.620831 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.622611 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.623934 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.625618 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.626277 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.626412 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.630919 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.630926 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.630935 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.630967 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.633792 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.634432 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.634438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.634443 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.634611 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.634982 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.634985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.634987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.635539 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.635878 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.636251 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.636625 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":347,"threads_started":1}
I20260807 20:00:58.641743 6528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.627546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:43919 (local address 127.0.0.1:45572)
0807 20:00:58.628452 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.628500 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.628662 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.629023 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.629027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.629780 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.630072 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.630082 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.631311 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.631315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.632448 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.632461 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.633183 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.633190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.633329 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.633892 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.633909 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.636104 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.638948 (+ 2844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.638957 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.638963 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.639491 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.639906 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.639911 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.639915 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.640081 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.640713 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.640720 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.640903 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.641043 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.641333 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":528,"threads_started":1}
I20260807 20:00:58.641803 6526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.627568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45572 (local address 127.5.197.190:43919)
0807 20:00:58.628120 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.628125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.628597 (+ 472us) server_negotiation.cc:407] Connection header received
0807 20:00:58.628779 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.628784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.628871 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.628988 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.630219 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.631160 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.632582 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.632992 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.633097 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.636305 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.636311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.636315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.636362 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.638823 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.639595 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.639599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.639603 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.639778 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.640192 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.640195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.640197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.640499 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.640637 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.641206 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.641425 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":261,"threads_started":1}
I20260807 20:00:58.643221 6520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 20:00:58.656148 6528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.643814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:42713 (local address 127.0.0.1:50700)
0807 20:00:58.644058 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.644076 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.644174 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.644454 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.644459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.644863 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.645029 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.645040 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.645924 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.645929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.646922 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.646935 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.647609 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.647615 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.647801 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.648252 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.648272 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.650464 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.653787 (+ 3323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.653792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.653796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.654148 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.654536 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.654539 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.654542 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.654704 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.655272 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.655275 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.655414 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.655572 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.655846 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260807 20:00:58.656164 6529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.640529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45586 (local address 127.5.197.190:43919)
0807 20:00:58.641064 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.641068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.641087 (+ 19us) server_negotiation.cc:407] Connection header received
0807 20:00:58.641126 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.641129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.641182 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.641272 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.642927 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.643742 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.645308 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.645725 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.645829 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.649699 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.649706 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.649711 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.649747 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.653473 (+ 3726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.654132 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.654137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.654140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.654274 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.654674 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.654679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.654682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.654981 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.655175 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.655506 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.655749 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":243,"threads_started":1}
I20260807 20:00:58.656375 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.643918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50700 (local address 127.5.197.189:42713)
0807 20:00:58.644074 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.644078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.644124 (+ 46us) server_negotiation.cc:407] Connection header received
0807 20:00:58.644270 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.644273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.644329 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.644406 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.645146 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.645790 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.647063 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.647471 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.647578 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.650628 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.650632 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.650636 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.650664 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.653641 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.654257 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.654261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.654264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.654428 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.654809 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.654812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.654814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.655076 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.655312 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.655738 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.656070 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 20:00:58.657315 6520 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 20:00:58.669641 6524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.658133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52180 (local address 127.5.197.188:46025)
0807 20:00:58.658271 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.658276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.658317 (+ 41us) server_negotiation.cc:407] Connection header received
0807 20:00:58.658471 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.658475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.658523 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.658595 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.659215 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.659896 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.660959 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.661355 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.661461 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.664558 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.664563 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.664566 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.664594 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.667196 (+ 2602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.667963 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.667967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.667969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.668077 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.668445 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.668449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.668451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.668705 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.668807 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.669224 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.669397 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":61}
I20260807 20:00:58.669976 6528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.658111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52180)
0807 20:00:58.658255 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.658272 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.658378 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.658624 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.658628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.658975 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.659092 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.659100 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.660009 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.660014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.660833 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.660846 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.661500 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.661505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.661692 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.662140 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.662166 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.664392 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.667334 (+ 2942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.667340 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.667344 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.667852 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.668183 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.668188 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.668191 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.668344 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.668824 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.668828 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.668983 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.669158 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.669590 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":110}
I20260807 20:00:58.672441 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.657762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50704 (local address 127.5.197.189:42713)
0807 20:00:58.657932 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.657937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.658426 (+ 489us) server_negotiation.cc:407] Connection header received
0807 20:00:58.658551 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.658556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.658614 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.658687 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.659889 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.660570 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.661700 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.662132 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.662256 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.666873 (+ 4617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.666878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.666882 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.666910 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.669723 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.670506 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.670512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.670515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.670675 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.671076 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.671080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.671082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.671394 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.671693 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.671928 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.672136 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 20:00:58.675582 6520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: Bootstrap starting.
I20260807 20:00:58.676980 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:00:58.679432 6520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:58.680717 6520 log.cc:824] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:58.680459 6289 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7c9d481290204177a465dddba75f7c57"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45586
I20260807 20:00:58.683524 6520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: No bootstrap required, opened a new log
I20260807 20:00:58.690493 6520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.690779 6520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3745bc3daf460ca1e698de8a4633a9, State: Initialized, Role: FOLLOWER
I20260807 20:00:58.691224 6520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.692143 6532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.692566 6532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:00:58.692955 6520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 20:00:58.701994 6544 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:00:58.702116 6544 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:00:58.702596 6326 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 4
I20260807 20:00:58.699492 6435 master_runner.cc:186] Error getting master registration for 127.5.197.190:43919: OK, instance_id { permanent_uuid: "7c9d481290204177a465dddba75f7c57" instance_seqno: 1786132857570889 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:00:58.710791 6435 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132857, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
I20260807 20:00:58.718092 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.703174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52192)
0807 20:00:58.703358 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.703377 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.703494 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.704007 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.704012 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.704510 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.704725 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.704738 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.706254 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.706260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.707712 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.707728 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.708714 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.708720 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.708930 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.709577 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.709599 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.712206 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.715342 (+ 3136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.715347 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.715351 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.715904 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.716286 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.716292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.716296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.716467 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.717088 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.717093 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.717272 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.717421 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.717694 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 20:00:58.718108 6524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.703482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.5.197.188:46025)
0807 20:00:58.703691 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.703697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.703716 (+ 19us) server_negotiation.cc:407] Connection header received
0807 20:00:58.703773 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.703778 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.703854 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.703965 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.704862 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.706078 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.707858 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.708568 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.708692 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.712403 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.712410 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.712415 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.712453 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.715213 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.716024 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.716029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.716033 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.716176 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.716577 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.716582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.716585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.716967 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.717122 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.717546 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.717758 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 20:00:58.723882 6326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57: Bootstrap starting.
I20260807 20:00:58.727020 6326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:58.728067 6326 log.cc:824] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:58.730746 6326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57: No bootstrap required, opened a new log
I20260807 20:00:58.735658 6326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.736004 6326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9d481290204177a465dddba75f7c57, State: Initialized, Role: FOLLOWER
I20260807 20:00:58.736408 6326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.737251 6547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.737706 6547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:00:58.738389 6326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:58.738533 6289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 20:00:58.738752 6289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:58.742975 6289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.745958 6289 leader_election.cc:288] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [CANDIDATE]: Term 1 election: Requested vote from peers ad54d22194df499c89c57977a5dbdca9 (127.5.197.189:42713), 3c3745bc3daf460ca1e698de8a4633a9 (127.5.197.188:46025)
I20260807 20:00:58.747570 6491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c9d481290204177a465dddba75f7c57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3c3745bc3daf460ca1e698de8a4633a9"
I20260807 20:00:58.748167 6491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:58.760413 6491 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9d481290204177a465dddba75f7c57 in term 1.
I20260807 20:00:58.761577 6259 leader_election.cc:302] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3745bc3daf460ca1e698de8a4633a9, 7c9d481290204177a465dddba75f7c57; no voters:
I20260807 20:00:58.762105 6547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:00:58.771982 6547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [term 1 LEADER]: Becoming Leader. State: Replica: 7c9d481290204177a465dddba75f7c57, State: Running, Role: LEADER
I20260807 20:00:58.773098 6547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.785765 6568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c9d481290204177a465dddba75f7c57. Latest consensus state: current_term: 1 leader_uuid: "7c9d481290204177a465dddba75f7c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.786234 6568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: This master's current role is: LEADER
W20260807 20:00:58.789248 6564 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:00:58.789426 6564 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:00:58.754038 6235 master_runner.cc:186] Error getting master registration for 127.5.197.189:42713: OK, instance_id { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" instance_seqno: 1786132858081117 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:00:58.790499 6235 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 20:00:58.793516 6578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:00:58.795833 6578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:00:58.801438 6426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } attempt: 5
W20260807 20:00:58.811206 6266 tablet.cc:2369] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:58.812925 6529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.779896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45594 (local address 127.5.197.190:43919)
0807 20:00:58.780087 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.780094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.788164 (+ 8070us) server_negotiation.cc:407] Connection header received
0807 20:00:58.788637 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.788643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.788724 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.788806 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.792968 (+ 4162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.794071 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.798457 (+ 4386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.799133 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.799240 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.802941 (+ 3701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.802947 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.802952 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.802990 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.806763 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.808423 (+ 1660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.808435 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.808439 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.808714 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.809482 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.809515 (+ 33us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.809519 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.810134 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.810544 (+ 410us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.811953 (+ 1409us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.812364 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 20:00:58 dist-test-slave-6bbx krb5kdc[6220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132858, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
I20260807 20:00:58.836048 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.802055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:46025 (local address 127.0.0.1:52212)
0807 20:00:58.802343 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 20:00:58.802365 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 20:00:58.802479 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:00:58.805789 (+ 3310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:00:58.805795 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:00:58.806290 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:00:58.806499 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.806511 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.819778 (+ 13267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.819784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.821142 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:00:58.821159 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.822206 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.822213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:00:58.822466 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.823112 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:00:58.823136 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:00:58.826253 (+ 3117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:00:58.833158 (+ 6905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.833163 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.833167 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.833687 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.834155 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:00:58.834160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:00:58.834163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:00:58.834330 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:00:58.835009 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:00:58.835015 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:00:58.835184 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 20:00:58.835335 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 20:00:58.835618 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260807 20:00:58.837260 6579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.802119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52212 (local address 127.5.197.188:46025)
0807 20:00:58.805427 (+ 3308us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.805433 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.805459 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:00:58.805520 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.805525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.805615 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.805747 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.812020 (+ 6273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.813192 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.821358 (+ 8166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.822007 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.822787 (+ 780us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.826465 (+ 3678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.826472 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.826478 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.826518 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.833009 (+ 6491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.833855 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.833860 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.833864 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.834017 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.834484 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.834489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.834493 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.834860 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.836462 (+ 1602us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.836590 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.836836 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3143,"thread_start_us":2860,"threads_started":1}
I20260807 20:00:58.844041 6491 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [term 1 FOLLOWER]: Refusing update from remote peer 7c9d481290204177a465dddba75f7c57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:58.844487 6524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.788612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52204 (local address 127.5.197.188:46025)
0807 20:00:58.788785 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.788791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.807339 (+ 18548us) server_negotiation.cc:407] Connection header received
0807 20:00:58.807489 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.807495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.807572 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.807687 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.826843 (+ 19156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.827942 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.830970 (+ 3028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.831634 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.831767 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.836702 (+ 4935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.836708 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.836712 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.836745 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.840254 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.841504 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.841509 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.841513 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.841649 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.842374 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.842379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.842382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.842706 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.843108 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.843956 (+ 848us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.844154 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 20:00:58.844487 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:00:58.786490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50708 (local address 127.5.197.189:42713)
0807 20:00:58.786668 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:58.786674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:58.806449 (+ 19775us) server_negotiation.cc:407] Connection header received
0807 20:00:58.806593 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:58.806597 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:58.806665 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:58.806748 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:58.817214 (+ 10466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.818315 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.822560 (+ 4245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:00:58.823152 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:00:58.823256 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:00:58.828853 (+ 5597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:00:58.828860 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:00:58.828864 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:00:58.828903 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:00:58.832207 (+ 3304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.842214 (+ 10007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.842219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.842222 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.842380 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:00:58.842822 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:00:58.842827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:00:58.842830 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:00:58.843176 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:00:58.843402 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 20:00:58.843924 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 20:00:58.844149 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 20:00:58.845116 6461 tablet.cc:2369] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:00:58.845504 6568 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:58.851902 6426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9: Bootstrap starting.
I20260807 20:00:58.856060 6426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9: Neither blocks nor log segments found. Creating new log.
I20260807 20:00:58.858796 6426 log.cc:824] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:00:58.864297 6426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9: No bootstrap required, opened a new log
I20260807 20:00:58.872223 6532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c9d481290204177a465dddba75f7c57. Latest consensus state: current_term: 1 leader_uuid: "7c9d481290204177a465dddba75f7c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.872543 6532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:00:58.876673 6581 mvcc.cc:205] Tried to move back new op lower bound from 7316000189813874688 to 7316000189544869888. Current Snapshot: MvccSnapshot[applied={T|T < 7316000189813874688}]
I20260807 20:00:58.880070 6583 mvcc.cc:205] Tried to move back new op lower bound from 7316000189813874688 to 7316000189544869888. Current Snapshot: MvccSnapshot[applied={T|T < 7316000189813874688}]
I20260807 20:00:58.892134 6547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7c9d481290204177a465dddba75f7c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.892472 6547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:58.893230 6578 catalog_manager.cc:1347] Generated new cluster ID: 0c3dc915291f4ae08357481c68dd4ac4
I20260807 20:00:58.893342 6578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:00:58.894181 6532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7c9d481290204177a465dddba75f7c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.894480 6532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:00:58.899174 6426 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.899639 6426 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad54d22194df499c89c57977a5dbdca9, State: Initialized, Role: FOLLOWER
I20260807 20:00:58.902422 6426 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } }
I20260807 20:00:58.910301 6589 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.912505 6589 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:00:58.912384 6426 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:00:58.912815 6391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:00:58.915776 6392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c9d481290204177a465dddba75f7c57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ad54d22194df499c89c57977a5dbdca9"
I20260807 20:00:58.920661 6391 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [term 1 FOLLOWER]: Refusing update from remote peer 7c9d481290204177a465dddba75f7c57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:00:58.924391 6392 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c9d481290204177a465dddba75f7c57 in term 1.
I20260807 20:00:58.929338 6568 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:00:58.959972 6578 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:00:58.962038 6578 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:00:58.985389 6547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7c9d481290204177a465dddba75f7c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.985725 6547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57 [sys.catalog]: This master's current role is: LEADER
I20260807 20:00:58.989544 6578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c9d481290204177a465dddba75f7c57: Generated new TSK 0
I20260807 20:00:58.990549 6578 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:00:58.997781 6589 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c9d481290204177a465dddba75f7c57. Latest consensus state: current_term: 1 leader_uuid: "7c9d481290204177a465dddba75f7c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:58.998060 6589 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:00:58.995784 6598 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7c9d481290204177a465dddba75f7c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9d481290204177a465dddba75f7c57" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 43919 } } peers { permanent_uuid: "ad54d22194df499c89c57977a5dbdca9" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 42713 } } peers { permanent_uuid: "3c3745bc3daf460ca1e698de8a4633a9" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 46025 } } }
I20260807 20:00:59.002182 6598 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:00:59.056802 6617 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260807 20:00:59.102880 5910 mini_kdc.cc:348] Time spent kdestroy: real 0.105s user 0.000s sys 0.030s
W20260807 20:00:59.130869 6529 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.116309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.5.197.190:43919)
0807 20:00:59.116530 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.116537 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.128550 (+ 12013us) server_negotiation.cc:407] Connection header received
0807 20:00:59.129042 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.129048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.129138 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.129230 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.130593 (+ 1363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45610: BlockingRecv error: recv got EOF from 127.0.0.1:45610 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260807 20:00:59.133447 6524 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.116994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52220 (local address 127.5.197.188:46025)
0807 20:00:59.117382 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.117392 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.131709 (+ 14317us) server_negotiation.cc:407] Connection header received
0807 20:00:59.131953 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.131959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.132042 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.132118 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.133161 (+ 1043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52220: BlockingRecv error: recv got EOF from 127.0.0.1:52220 (error 108)
Metrics: {"server-negotiator.queue_time_us":261}
W20260807 20:00:59.135550 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.117184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50716 (local address 127.5.197.189:42713)
0807 20:00:59.117538 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.117544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.134049 (+ 16505us) server_negotiation.cc:407] Connection header received
0807 20:00:59.134291 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.134296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.134388 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.134453 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.135340 (+ 887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50716: BlockingRecv error: recv got EOF from 127.0.0.1:50716 (error 108)
Metrics: {"server-negotiator.queue_time_us":225}
W20260807 20:00:59.152927 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.150290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50722 (local address 127.5.197.189:42713)
0807 20:00:59.150475 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.150481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.150985 (+ 504us) server_negotiation.cc:407] Connection header received
0807 20:00:59.151246 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.151252 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.151392 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.151523 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.152645 (+ 1122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50722: BlockingRecv error: recv got EOF from 127.0.0.1:50722 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 20:00:59.159523 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.157788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.5.197.189:42713)
0807 20:00:59.157956 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.157962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.158059 (+ 97us) server_negotiation.cc:407] Connection header received
0807 20:00:59.158332 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.158337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.158424 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.158528 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.159299 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50726: BlockingRecv error: recv got EOF from 127.0.0.1:50726 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 20:00:59.169724 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.164830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50730 (local address 127.5.197.189:42713)
0807 20:00:59.164999 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.165004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.168224 (+ 3220us) server_negotiation.cc:407] Connection header received
0807 20:00:59.168424 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.168429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.168530 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.168648 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.169466 (+ 818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50730: BlockingRecv error: recv got EOF from 127.0.0.1:50730 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 20:00:59.183264 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.180828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50742 (local address 127.5.197.189:42713)
0807 20:00:59.181066 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.181073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.181647 (+ 574us) server_negotiation.cc:407] Connection header received
0807 20:00:59.181867 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.181874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.181970 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.182112 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.183021 (+ 909us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50742: BlockingRecv error: recv got EOF from 127.0.0.1:50742 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
W20260807 20:00:59.197381 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.195050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50754 (local address 127.5.197.189:42713)
0807 20:00:59.195261 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.195267 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.195933 (+ 666us) server_negotiation.cc:407] Connection header received
0807 20:00:59.196140 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.196146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.196245 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.196358 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.197143 (+ 785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50754: BlockingRecv error: recv got EOF from 127.0.0.1:50754 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 20:00:59.220198 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.217648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50756 (local address 127.5.197.189:42713)
0807 20:00:59.217859 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.217866 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.218389 (+ 523us) server_negotiation.cc:407] Connection header received
0807 20:00:59.218647 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.218653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.218754 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.218843 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.219946 (+ 1103us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50756: BlockingRecv error: recv got EOF from 127.0.0.1:50756 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 20:00:59.257879 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.255898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50758 (local address 127.5.197.189:42713)
0807 20:00:59.256102 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.256110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.256461 (+ 351us) server_negotiation.cc:407] Connection header received
0807 20:00:59.256629 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.256635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.256726 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.256840 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.257600 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50758: BlockingRecv error: recv got EOF from 127.0.0.1:50758 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 20:00:59.327358 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.325428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50768 (local address 127.5.197.189:42713)
0807 20:00:59.325679 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.325686 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.325948 (+ 262us) server_negotiation.cc:407] Connection header received
0807 20:00:59.326154 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.326159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.326232 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.326331 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.327132 (+ 801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50768: BlockingRecv error: recv got EOF from 127.0.0.1:50768 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260807 20:00:59.460531 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.458532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50774 (local address 127.5.197.189:42713)
0807 20:00:59.458748 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.458755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.459003 (+ 248us) server_negotiation.cc:407] Connection header received
0807 20:00:59.459198 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.459204 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.459316 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.459456 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.460248 (+ 792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50774: BlockingRecv error: recv got EOF from 127.0.0.1:50774 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 20:00:59.704219 6544 catalog_manager.cc:1259] Loaded cluster ID: 0c3dc915291f4ae08357481c68dd4ac4
I20260807 20:00:59.704326 6544 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: loading cluster ID for follower catalog manager: success
I20260807 20:00:59.706812 6544 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: acquiring CA information for follower catalog manager: success
I20260807 20:00:59.708614 6544 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3c3745bc3daf460ca1e698de8a4633a9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 20:00:59.722404 6432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:00:59.720546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50780 (local address 127.5.197.189:42713)
0807 20:00:59.720762 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 20:00:59.720768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:00:59.720984 (+ 216us) server_negotiation.cc:407] Connection header received
0807 20:00:59.721189 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:00:59.721194 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:00:59.721322 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:00:59.721418 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:00:59.722188 (+ 770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50780: BlockingRecv error: recv got EOF from 127.0.0.1:50780 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 20:01:00.061056 6617 catalog_manager.cc:1259] Loaded cluster ID: 0c3dc915291f4ae08357481c68dd4ac4
I20260807 20:01:00.061187 6617 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9: loading cluster ID for follower catalog manager: success
I20260807 20:01:00.063800 6617 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9: acquiring CA information for follower catalog manager: success
I20260807 20:01:00.065603 6617 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ad54d22194df499c89c57977a5dbdca9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:01:00.245636 6698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:00.239179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50790 (local address 127.5.197.189:42713)
0807 20:01:00.240022 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:00.240029 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:00.240050 (+ 21us) server_negotiation.cc:407] Connection header received
0807 20:01:00.240134 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:00.240138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:00.240271 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:00.240392 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:00.240833 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.241844 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.243267 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.243795 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.243922 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:00.244450 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:00.244979 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:00.245143 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:00.245232 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 20:01:00.245322 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":545,"threads_started":1}
I20260807 20:01:00.257225 6709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:00.251516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52228 (local address 127.5.197.188:46025)
0807 20:01:00.252131 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:00.252136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:00.252156 (+ 20us) server_negotiation.cc:407] Connection header received
0807 20:01:00.252266 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:00.252270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:00.252430 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:00.252580 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:00.252985 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.253760 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.255094 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.255512 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.255620 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:00.256141 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:00.256629 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:00.256759 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:00.256865 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 20:01:00.256946 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":386,"threads_started":1}
I20260807 20:01:00.271504 6709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:00.263598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52236 (local address 127.5.197.188:46025)
0807 20:01:00.263776 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:00.263781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:00.264996 (+ 1215us) server_negotiation.cc:407] Connection header received
0807 20:01:00.265160 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:00.265166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:00.265252 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:00.265333 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:00.266319 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.267329 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.269483 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.270072 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.270156 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:00.270722 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:00.270846 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:00.270920 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:00.271148 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 20:01:00.271226 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 20:01:00.272037 6698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:00.263547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50798 (local address 127.5.197.189:42713)
0807 20:01:00.263756 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:00.263763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:00.265594 (+ 1831us) server_negotiation.cc:407] Connection header received
0807 20:01:00.265902 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:00.265908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:00.265991 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:00.266054 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:00.266755 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.267841 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.269930 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.270550 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.270638 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:00.271210 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:00.271326 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:00.271397 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:00.271625 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 20:01:00.271745 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 20:01:00.272356 6715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:00.263514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45626 (local address 127.5.197.190:43919)
0807 20:01:00.264115 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:00.264121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:00.264697 (+ 576us) server_negotiation.cc:407] Connection header received
0807 20:01:00.265029 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:00.265035 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:00.265218 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:00.265350 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:00.266251 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.267343 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.269638 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:00.270244 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:00.270336 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:00.271018 (+ 682us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:00.271403 (+ 385us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:00.271486 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:00.271993 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 20:01:00.272079 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":372,"threads_started":1}
I20260807 20:01:00.278304 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6235
I20260807 20:01:00.279407 6319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:01:00.390158 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6235
W20260807 20:01:00.417518 6457 connection.cc:535] server connection from 127.0.0.1:52192 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 20:01:00.418233 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6338
I20260807 20:01:00.419262 6420 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:01:00.524607 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6338
I20260807 20:01:00.550830 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6435
I20260807 20:01:00.551946 6515 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:01:00.659277 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6435
2026-08-07T20:01:00Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5056 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:01:00 dist-test-slave-6bbx krb5kdc[6726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:01:00 dist-test-slave-6bbx krb5kdc[6726](info): set up 2 sockets
Aug 07 20:01:00 dist-test-slave-6bbx krb5kdc[6726](info): commencing operation
krb5kdc: starting...
W20260807 20:01:01.900384 5910 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/test-user.keytab.
Aug 07 20:01:02 dist-test-slave-6bbx krb5kdc[6726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:01:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:01:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.197.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
Entry for principal kudu/127.5.197.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab.
I20260807 20:01:02.234366 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45443
--webserver_interface=127.5.197.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45443,127.5.197.189:34631,127.5.197.188:43439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:01:02.578013 6753 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:01:02.578425 6753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:01:02.578543 6753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:01:02.578668 6753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:01:02.586441 6753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:01:02.586537 6753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:01:02.586629 6753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:01:02.586694 6753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:01:02.586776 6753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:01:02.596486 6753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45443,127.5.197.189:34631,127.5.197.188:43439
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.190.keytab
--principal=kudu/127.5.197.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.190:45443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.197.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:01:02.597756 6753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:01:02.599174 6753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:01:02.610482 6763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:01:02.610540 6759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:01:02.610571 6758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:01:02.611536 6753 server_base.cc:1034] running on GCE node
I20260807 20:01:02.612319 6753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:01:02.613619 6753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:01:02.614849 6753 hybrid_clock.cc:648] HybridClock initialized: now 1786132862614768 us; error 38 us; skew 500 ppm
I20260807 20:01:02.615161 6753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:01:02 dist-test-slave-6bbx krb5kdc[6726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:01:02.618256 6753 init.cc:377] Logged in from keytab as kudu/127.5.197.190@KRBTEST.COM (short username kudu)
I20260807 20:01:02.619655 6753 webserver.cc:460] Webserver started at http://127.5.197.190:35371/ using document root <none> and password file <none>
I20260807 20:01:02.620333 6753 fs_manager.cc:359] Metadata directory not provided
I20260807 20:01:02.620420 6753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:01:02.620682 6753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:01:02.623489 6753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data/instance:
uuid: "b3dbac220686485284ca809b50fc7c7f"
format_stamp: "Formatted at 2026-08-07 20:01:02 on dist-test-slave-6bbx"
server_key: "d1fe8b692167f5d0b8698fd1c4b20cb7"
server_key_iv: "61e71e1077ba69be978d693a1540d340"
server_key_version: "encryptionkey@0"
I20260807 20:01:02.624266 6753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/wal/instance:
uuid: "b3dbac220686485284ca809b50fc7c7f"
format_stamp: "Formatted at 2026-08-07 20:01:02 on dist-test-slave-6bbx"
server_key: "d1fe8b692167f5d0b8698fd1c4b20cb7"
server_key_iv: "61e71e1077ba69be978d693a1540d340"
server_key_version: "encryptionkey@0"
I20260807 20:01:02.629017 6753 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 20:01:02.632181 6771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:01:02.633390 6753 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 20:01:02.633533 6753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/wal
uuid: "b3dbac220686485284ca809b50fc7c7f"
format_stamp: "Formatted at 2026-08-07 20:01:02 on dist-test-slave-6bbx"
server_key: "d1fe8b692167f5d0b8698fd1c4b20cb7"
server_key_iv: "61e71e1077ba69be978d693a1540d340"
server_key_version: "encryptionkey@0"
I20260807 20:01:02.633703 6753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:01:02.659718 6753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:01:02.663491 6753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:01:02.663755 6753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:01:02.681116 6753 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.190:45443
I20260807 20:01:02.681139 6834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.190:45443 every 8 connection(s)
I20260807 20:01:02.682438 6753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/data/info.pb
I20260807 20:01:02.686017 6835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:01:02.687003 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6753
I20260807 20:01:02.687191 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-0/wal/instance
I20260807 20:01:02.687757 5910 external_mini_cluster.cc:1428] Setting key fbd4a1430b4ddffa9243a5fbee98269d
I20260807 20:01:02.694377 6835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:01:02 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:01:02.716921 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.697898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45443 (local address 127.0.0.1:35652)
0807 20:01:02.698770 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.698825 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:02.700791 (+ 1966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:02.701601 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:02.701607 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:02.702308 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:02.702638 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:02.702656 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:02.704407 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:02.704411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:02.705539 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:02.705552 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:02.706713 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:02.706718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:02.706838 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:02.707433 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:02.707454 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:02.709743 (+ 2289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:02.713033 (+ 3290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:02.713043 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:02.713051 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:02.713422 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:02.713791 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:02.713794 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:02.713796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:02.713938 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:02.714628 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:02.714640 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:02.714845 (+ 205us) client_negotiation.cc:769] Sending connection context
0807 20:01:02.715065 (+ 220us) client_negotiation.cc:240] Negotiation successful
0807 20:01:02.715636 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":121,"thread_start_us":446,"threads_started":1}
I20260807 20:01:02.716950 6839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.697897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35652 (local address 127.5.197.190:45443)
0807 20:01:02.699605 (+ 1708us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:02.699613 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:02.699698 (+ 85us) server_negotiation.cc:407] Connection header received
0807 20:01:02.701153 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:02.701161 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:02.701385 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:02.701567 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:02.702838 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:02.704240 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:02.705694 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:02.706488 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:02.706646 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:02.709977 (+ 3331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:02.709986 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:02.710001 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:02.710040 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:02.712908 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:02.713538 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:02.713544 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:02.713546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:02.713688 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:02.714038 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:02.714043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:02.714045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:02.714503 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:02.714686 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:02.715211 (+ 525us) server_negotiation.cc:299] Negotiation successful
0807 20:01:02.715477 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1494,"spinlock_wait_cycles":16128,"thread_start_us":1290,"threads_started":1}
I20260807 20:01:02.720156 6835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:01:02.721227 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.720777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46024)
0807 20:01:02.720956 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.721083 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 20:01:02.721495 6776 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.5.197.189@KRBTEST.COM; defaulting to no policy
I20260807 20:01:02.722959 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.722589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46030)
0807 20:01:02.722741 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.722808 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 20:01:02.723146 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:34631: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab.
Entry for principal kudu/127.5.197.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab.
I20260807 20:01:02.761031 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:34631
--webserver_interface=127.5.197.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab
--principal=kudu/127.5.197.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45443,127.5.197.189:34631,127.5.197.188:43439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:01:02.772470 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } attempt: 1
I20260807 20:01:02.773656 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.773212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46038)
0807 20:01:02.773406 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.773528 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 20:01:02.774549 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.774245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46050)
0807 20:01:02.774356 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.774421 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 20:01:02.774719 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:34631: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
I20260807 20:01:02.842975 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } attempt: 2
I20260807 20:01:02.844272 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.843700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46056)
0807 20:01:02.843965 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.844087 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 20:01:02.845350 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.844944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46060)
0807 20:01:02.845101 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.845189 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 20:01:02.845556 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:34631: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
I20260807 20:01:02.936791 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } attempt: 3
I20260807 20:01:02.937947 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.937506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46062)
0807 20:01:02.937705 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.937796 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 20:01:02.938936 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:02.938567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46070)
0807 20:01:02.938714 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:02.938785 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 20:01:02.939121 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:34631: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
I20260807 20:01:03.082350 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } attempt: 4
I20260807 20:01:03.083475 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.082953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46078)
0807 20:01:03.083254 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.083339 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260807 20:01:03.084471 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.084129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46094)
0807 20:01:03.084276 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.084354 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 20:01:03.084637 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.189:34631: Network error: Client connection negotiation failed: client connection to 127.5.197.189:34631: connect: Connection refused (error 111)
W20260807 20:01:03.104092 6847 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:01:03.104439 6847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:01:03.104537 6847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:01:03.104650 6847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:01:03.111842 6847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:01:03.111928 6847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:01:03.112018 6847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:01:03.112082 6847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:01:03.112174 6847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:01:03.121954 6847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45443,127.5.197.189:34631,127.5.197.188:43439
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.189.keytab
--principal=kudu/127.5.197.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.189:34631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.197.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:01:03.123222 6847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:01:03.124586 6847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:01:03.135924 6855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:01:03.135876 6856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:01:03.135972 6858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:01:03.136729 6847 server_base.cc:1034] running on GCE node
I20260807 20:01:03.137490 6847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:01:03.138813 6847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:01:03.140030 6847 hybrid_clock.cc:648] HybridClock initialized: now 1786132863139953 us; error 44 us; skew 500 ppm
I20260807 20:01:03.140308 6847 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:01:03.143584 6847 init.cc:377] Logged in from keytab as kudu/127.5.197.189@KRBTEST.COM (short username kudu)
I20260807 20:01:03.144979 6847 webserver.cc:460] Webserver started at http://127.5.197.189:43401/ using document root <none> and password file <none>
I20260807 20:01:03.145630 6847 fs_manager.cc:359] Metadata directory not provided
I20260807 20:01:03.145714 6847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:01:03.145977 6847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:01:03.148885 6847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data/instance:
uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93"
format_stamp: "Formatted at 2026-08-07 20:01:03 on dist-test-slave-6bbx"
server_key: "13958697ab183c111d2901ae859ba837"
server_key_iv: "a0f56e3c66153e386bf97f9c66e4e4a9"
server_key_version: "encryptionkey@0"
I20260807 20:01:03.149611 6847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/wal/instance:
uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93"
format_stamp: "Formatted at 2026-08-07 20:01:03 on dist-test-slave-6bbx"
server_key: "13958697ab183c111d2901ae859ba837"
server_key_iv: "a0f56e3c66153e386bf97f9c66e4e4a9"
server_key_version: "encryptionkey@0"
I20260807 20:01:03.154660 6847 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 20:01:03.157964 6867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:01:03.159269 6847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 20:01:03.159440 6847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/wal
uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93"
format_stamp: "Formatted at 2026-08-07 20:01:03 on dist-test-slave-6bbx"
server_key: "13958697ab183c111d2901ae859ba837"
server_key_iv: "a0f56e3c66153e386bf97f9c66e4e4a9"
server_key_version: "encryptionkey@0"
I20260807 20:01:03.159626 6847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:01:03.175065 6847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:01:03.178812 6847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:01:03.179056 6847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:01:03.195852 6847 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.189:34631
I20260807 20:01:03.195879 6937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.189:34631 every 8 connection(s)
I20260807 20:01:03.197098 6847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/data/info.pb
I20260807 20:01:03.200729 6938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:01:03.202696 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6847
I20260807 20:01:03.202850 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-1/wal/instance
I20260807 20:01:03.203298 5910 external_mini_cluster.cc:1428] Setting key 39bfacbd8132163b37032b84afb1821d
I20260807 20:01:03.207489 6938 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:01:03.226905 6839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.210019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35668 (local address 127.5.197.190:45443)
0807 20:01:03.210223 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.210229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.211334 (+ 1105us) server_negotiation.cc:407] Connection header received
0807 20:01:03.213221 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.213227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.213315 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.213426 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.214862 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.215797 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.217280 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.217831 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.217942 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.221396 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.221401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.221404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.221436 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.224011 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.224693 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.224697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.224699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.224815 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.225219 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.225224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.225226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.225518 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.225665 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.226346 (+ 681us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.226590 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 20:01:03.227937 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.210403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45443 (local address 127.0.0.1:35668)
0807 20:01:03.211163 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.211217 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.212950 (+ 1733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.213618 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.213626 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.214134 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.214681 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.214699 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.215926 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.215930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.217124 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.217136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.218019 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.218023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.218212 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.218830 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.218856 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.221181 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.224139 (+ 2958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.224148 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.224164 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.224582 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.224924 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.224929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.224933 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.225112 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.225646 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.225654 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.225992 (+ 338us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.226238 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.226742 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":306,"threads_started":1}
I20260807 20:01:03.229638 6938 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.5.197.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.197.188@KRBTEST.COM" created.
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 20:01:03.245121 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.230251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46108)
0807 20:01:03.230460 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.230474 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.230550 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.231589 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.231593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.232041 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.232171 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.232179 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.233517 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.233522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.234395 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.234407 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.235229 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.235235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.235396 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.235930 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.235947 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.239797 (+ 3850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.242727 (+ 2930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.242731 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.242735 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.243158 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.243500 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.243504 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.243507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.243693 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.244249 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.244253 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.244390 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.244517 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.244768 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117}
I20260807 20:01:03.245169 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.230547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46108 (local address 127.5.197.189:34631)
0807 20:01:03.231207 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.231212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.231236 (+ 24us) server_negotiation.cc:407] Connection header received
0807 20:01:03.231277 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.231282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.231450 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.231585 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.232328 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.233387 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.234527 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.235097 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.235205 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.240029 (+ 4824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.240041 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.240054 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.240084 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.242594 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.243286 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.243293 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.243295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.243406 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.243780 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.243784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.243786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.244131 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.244287 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.244664 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.244878 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":523,"thread_start_us":375,"threads_started":1}
I20260807 20:01:03.247975 6938 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:01:03.249061 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.248560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56370)
0807 20:01:03.248739 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.248892 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 20:01:03.249300 6871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.250808 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.250453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56386)
0807 20:01:03.250602 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.250695 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 20:01:03.251086 6938 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.197.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab.
Entry for principal kudu/127.5.197.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab.
I20260807 20:01:03.276836 5910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
/tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:43439
--webserver_interface=127.5.197.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab
--principal=kudu/127.5.197.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.197.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.197.190:45443,127.5.197.189:34631,127.5.197.188:43439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:01:03.300427 6938 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 1
I20260807 20:01:03.301620 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.301151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56396)
0807 20:01:03.301351 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.301462 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 20:01:03.302695 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.302317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56404)
0807 20:01:03.302473 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.302554 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 20:01:03.302918 6938 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.371110 6938 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 2
I20260807 20:01:03.372283 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.371848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56408)
0807 20:01:03.372036 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.372126 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 20:01:03.373284 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.372967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56412)
0807 20:01:03.373103 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.373170 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 20:01:03.373481 6938 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.383847 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } attempt: 5
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 20:01:03.396471 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.384418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46118)
0807 20:01:03.384593 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.384611 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.384729 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.385109 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.385114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.385516 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.385688 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.385697 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.386673 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.386678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.387534 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.387547 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.388313 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.388318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.388537 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.389091 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.389110 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.391257 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.394104 (+ 2847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.394110 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.394114 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.394474 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.394816 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.394821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.394825 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.394972 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.395473 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.395478 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.395629 (+ 151us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.395819 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.396104 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 20:01:03.396471 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.384623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.5.197.189:34631)
0807 20:01:03.384795 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.384800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.384820 (+ 20us) server_negotiation.cc:407] Connection header received
0807 20:01:03.384903 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.384907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.384965 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.385045 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.385833 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.386541 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.387706 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.388169 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.388281 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.391441 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.391445 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.391449 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.391481 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.393981 (+ 2500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.394584 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.394588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.394590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.394711 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.395072 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.395077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.395080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.395348 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.395488 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.395943 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.396146 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 20:01:03.397408 6835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:01:03.398427 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.398064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56424)
0807 20:01:03.398219 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.398291 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 20:01:03.399284 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.398982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56440)
0807 20:01:03.399125 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.399192 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 20:01:03.399475 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.450675 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 1
I20260807 20:01:03.451841 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.451351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56456)
0807 20:01:03.451531 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.451622 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 20:01:03.452818 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.452499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56462)
0807 20:01:03.452647 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.452719 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 20:01:03.453024 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.464679 6938 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 3
I20260807 20:01:03.465607 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.465181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56476)
0807 20:01:03.465374 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.465463 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 20:01:03.466538 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.466151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56490)
0807 20:01:03.466361 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.466434 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260807 20:01:03.466733 6938 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.521234 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 2
I20260807 20:01:03.522348 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.521842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56506)
0807 20:01:03.522076 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.522180 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 20:01:03.523269 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.522934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56518)
0807 20:01:03.523082 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.523161 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 20:01:03.523466 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.609907 6938 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 4
I20260807 20:01:03.611123 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.610618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56530)
0807 20:01:03.610872 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.610958 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 20:01:03.612273 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.611819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56532)
0807 20:01:03.612047 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.612136 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
W20260807 20:01:03.612479 6938 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
W20260807 20:01:03.619128 6947 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:01:03.619457 6947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:01:03.619549 6947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:01:03.619688 6947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:01:03.626864 6947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:01:03.626956 6947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:01:03.627050 6947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:01:03.627116 6947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:01:03.627200 6947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:01:03.629649 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 3
I20260807 20:01:03.630599 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.630179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56548)
0807 20:01:03.630358 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.630442 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 20:01:03.631577 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.631207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56558)
0807 20:01:03.631407 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.631477 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260807 20:01:03.631807 6835 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.197.188:43439: Network error: Client connection negotiation failed: client connection to 127.5.197.188:43439: connect: Connection refused (error 111)
I20260807 20:01:03.637240 6947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.197.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.197.190:45443,127.5.197.189:34631,127.5.197.188:43439
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/krb5kdc/kudu_127.5.197.188.keytab
--principal=kudu/127.5.197.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.197.188:43439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.197.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 20:01:03.638605 6947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:01:03.639945 6947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:01:03.651261 6953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:01:03.651327 6958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:01:03.651296 6952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:01:03.652268 6947 server_base.cc:1034] running on GCE node
I20260807 20:01:03.653024 6947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:01:03.654309 6947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:01:03.655534 6947 hybrid_clock.cc:648] HybridClock initialized: now 1786132863655460 us; error 46 us; skew 500 ppm
I20260807 20:01:03.655874 6947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:01:03.665998 6947 init.cc:377] Logged in from keytab as kudu/127.5.197.188@KRBTEST.COM (short username kudu)
I20260807 20:01:03.667431 6947 webserver.cc:460] Webserver started at http://127.5.197.188:44085/ using document root <none> and password file <none>
I20260807 20:01:03.668238 6947 fs_manager.cc:359] Metadata directory not provided
I20260807 20:01:03.668350 6947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:01:03.668709 6947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:01:03.671757 6947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data/instance:
uuid: "debcdc15280a470486bdedf65a0c26da"
format_stamp: "Formatted at 2026-08-07 20:01:03 on dist-test-slave-6bbx"
server_key: "879a512207e62f0a105a5d38e67e7579"
server_key_iv: "e0257a8cbac292e3dceef56f0ca96b90"
server_key_version: "encryptionkey@0"
I20260807 20:01:03.672544 6947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/wal/instance:
uuid: "debcdc15280a470486bdedf65a0c26da"
format_stamp: "Formatted at 2026-08-07 20:01:03 on dist-test-slave-6bbx"
server_key: "879a512207e62f0a105a5d38e67e7579"
server_key_iv: "e0257a8cbac292e3dceef56f0ca96b90"
server_key_version: "encryptionkey@0"
I20260807 20:01:03.677672 6947 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 20:01:03.681242 6967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:01:03.682736 6947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 20:01:03.682904 6947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data,/tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/wal
uuid: "debcdc15280a470486bdedf65a0c26da"
format_stamp: "Formatted at 2026-08-07 20:01:03 on dist-test-slave-6bbx"
server_key: "879a512207e62f0a105a5d38e67e7579"
server_key_iv: "e0257a8cbac292e3dceef56f0ca96b90"
server_key_version: "encryptionkey@0"
I20260807 20:01:03.683097 6947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:01:03.696177 6947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:01:03.699839 6947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:01:03.700084 6947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:01:03.717022 6947 rpc_server.cc:307] RPC server started. Bound to: 127.5.197.188:43439
I20260807 20:01:03.717042 7044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.197.188:43439 every 8 connection(s)
I20260807 20:01:03.718317 6947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/data/info.pb
I20260807 20:01:03.719312 5910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu as pid 6947
I20260807 20:01:03.719516 5910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskQ2gOvL/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132491354022-5910-0/minicluster-data/master-2/wal/instance
I20260807 20:01:03.720096 5910 external_mini_cluster.cc:1428] Setting key adb07b082dcc05203a707712cc545f53
I20260807 20:01:03.722692 7045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:01:03.730933 7045 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
I20260807 20:01:03.742908 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.721816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56570 (local address 127.5.197.188:43439)
0807 20:01:03.722569 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.722581 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.722623 (+ 42us) server_negotiation.cc:407] Connection header received
0807 20:01:03.724239 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.724260 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.724622 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.724954 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.726682 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.728119 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.729909 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.730568 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.730711 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.735497 (+ 4786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.735509 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.735522 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.735567 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.738775 (+ 3208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.739498 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.739504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.739509 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.739702 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.740111 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.740117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.740120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.740793 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.741114 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.741431 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.741852 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":342,"threads_started":1}
I20260807 20:01:03.748724 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.733909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.190:45443 (local address 127.0.0.1:35674)
0807 20:01:03.734874 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.734918 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.735098 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.735455 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.735460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.736148 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.736514 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.736526 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.737817 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.737822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.738987 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.739000 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.739903 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.739908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.740031 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.740572 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.740599 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.742943 (+ 2344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.746274 (+ 3331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.746286 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.746293 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.746674 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.747029 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.747034 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.747038 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.747173 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.747691 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.747699 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.747854 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.748023 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.748325 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":559,"threads_started":1}
I20260807 20:01:03.748775 7053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.733934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35674 (local address 127.5.197.190:45443)
0807 20:01:03.734555 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.734561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.735026 (+ 465us) server_negotiation.cc:407] Connection header received
0807 20:01:03.735208 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.735212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.735279 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.735402 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.736657 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.737654 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.739125 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.739718 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.739836 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.743126 (+ 3290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.743132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.743137 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.743178 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.746148 (+ 2970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.746791 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.746797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.746800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.746926 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.747271 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.747277 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.747280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.747528 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.747708 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.748164 (+ 456us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.748380 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":251,"threads_started":1}
I20260807 20:01:03.750000 7045 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.190@KRBTEST.COM
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
I20260807 20:01:03.759893 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.745752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35680 (local address 127.5.197.190:45443)
0807 20:01:03.746297 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.746301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.746319 (+ 18us) server_negotiation.cc:407] Connection header received
0807 20:01:03.746360 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.746363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.746411 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.746497 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.747745 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.748556 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.749952 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.750398 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.750506 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.754958 (+ 4452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.754962 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.754966 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.754993 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.757415 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.757988 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.757993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.757996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.758124 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.758471 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.758476 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.758479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.758800 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.759061 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.759263 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.759479 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":245,"threads_started":1}
I20260807 20:01:03.763322 6944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.750678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.5.197.189:34631)
0807 20:01:03.750893 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.750899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.750918 (+ 19us) server_negotiation.cc:407] Connection header received
0807 20:01:03.750971 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.750975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.751033 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.751122 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.751773 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.752815 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.754258 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.754657 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.754747 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.757562 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.757568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.757573 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.757607 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.760637 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.761251 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.761255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.761257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.761408 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.761901 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.761907 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.761910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.762321 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.762455 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.762830 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.763034 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 20:01:03.763350 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.750559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.189:34631 (local address 127.0.0.1:46130)
0807 20:01:03.750763 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.750779 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.750849 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.751165 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.751168 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.751479 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.751616 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.751623 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.752961 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.752964 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.754123 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.754139 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.754804 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.754810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.754992 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.755430 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.755451 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.757380 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.760757 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.760760 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.760763 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.761150 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.761569 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.761574 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.761578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.761765 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.762435 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.762438 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.762588 (+ 150us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.762739 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.763021 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260807 20:01:03.764219 7045 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.197.189@KRBTEST.COM
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.188@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
I20260807 20:01:03.777731 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.764999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56582)
0807 20:01:03.765144 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.765162 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.765249 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.765501 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.765509 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.765978 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.766142 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.766152 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.767276 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.767280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.768523 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.768539 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.769236 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.769243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.769450 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.769923 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.769945 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.771971 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.775158 (+ 3187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.775163 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.775167 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.775650 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.776051 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.776055 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.776059 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.776205 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.776818 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.776822 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.776983 (+ 161us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.777104 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.777374 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 20:01:03.777963 7059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.761595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.5.197.189:34631)
0807 20:01:03.762269 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.762274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.762302 (+ 28us) server_negotiation.cc:407] Connection header received
0807 20:01:03.762346 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.762350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.762426 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.762519 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.764137 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.765139 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.766637 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.767249 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.767342 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.771901 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.771906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.771909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.771938 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.775037 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.775780 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.775785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.775789 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.775937 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.776315 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.776320 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.776323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.776666 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.776920 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.777189 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.777406 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":312,"threads_started":1}
I20260807 20:01:03.777967 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.765050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56582 (local address 127.5.197.188:43439)
0807 20:01:03.765211 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.765217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.765234 (+ 17us) server_negotiation.cc:407] Connection header received
0807 20:01:03.765337 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.765341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.765392 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.765458 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.766279 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.767144 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.768664 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.769073 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.769163 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.772135 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.772141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.772146 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.772179 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.775018 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.775780 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.775785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.775789 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.775947 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.776381 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.776386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.776389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.776702 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.776821 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.777214 (+ 393us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.777561 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":98,"server-negotiator.queue_time_us":66}
I20260807 20:01:03.782636 5910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:01:03.783494 7045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: Bootstrap starting.
I20260807 20:01:03.786938 7045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: Neither blocks nor log segments found. Creating new log.
I20260807 20:01:03.788033 7045 log.cc:824] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: Log is configured to *not* fsync() on all Append() calls
I20260807 20:01:03.785441 6805 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b3dbac220686485284ca809b50fc7c7f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35680
I20260807 20:01:03.790617 7045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: No bootstrap required, opened a new log
I20260807 20:01:03.797384 7045 raft_consensus.cc:348] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.797672 7045 raft_consensus.cc:729] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: debcdc15280a470486bdedf65a0c26da, State: Initialized, Role: FOLLOWER
I20260807 20:01:03.798069 7045 consensus_queue.cc:260] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.798975 7061 sys_catalog.cc:455] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:03.799363 7061 sys_catalog.cc:458] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:01:03.799889 7045 sys_catalog.cc:564] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [sys.catalog]: configured and running, proceeding with master startup.
W20260807 20:01:03.809052 7077 catalog_manager.cc:1558] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 20:01:03.809032 6835 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 4
W20260807 20:01:03.809173 7077 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:01:03.806501 6947 master_runner.cc:186] Error getting master registration for 127.5.197.190:45443: OK, instance_id { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" instance_seqno: 1786132862676046 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:01:03.817400 6947 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132862, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.190@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
I20260807 20:01:03.825345 6838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.809598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56586)
0807 20:01:03.809967 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.809989 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.810102 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.810481 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.810486 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.811016 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.811228 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.811241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.812697 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.812703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.814203 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.814220 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.815270 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.815276 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.815500 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.816263 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.816289 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.818985 (+ 2696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.822514 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.822520 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.822524 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.823041 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.823422 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.823428 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.823432 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.823604 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.824343 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.824349 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.824513 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.824668 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.824960 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243}
I20260807 20:01:03.825349 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.809940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56586 (local address 127.5.197.188:43439)
0807 20:01:03.810123 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.810129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.810183 (+ 54us) server_negotiation.cc:407] Connection header received
0807 20:01:03.810240 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.810245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.810327 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.810436 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.811381 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.812555 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.814351 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.815112 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.815237 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.819162 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.819169 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.819172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.819200 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.822373 (+ 3173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.823155 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.823161 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.823168 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.823309 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.823762 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.823767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.823771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.824192 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.824351 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.824790 (+ 439us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.825004 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 20:01:03.831533 6835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f: Bootstrap starting.
I20260807 20:01:03.835692 6835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f: Neither blocks nor log segments found. Creating new log.
I20260807 20:01:03.837060 6835 log.cc:824] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f: Log is configured to *not* fsync() on all Append() calls
I20260807 20:01:03.840487 6835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f: No bootstrap required, opened a new log
I20260807 20:01:03.848042 6835 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.848438 6835 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3dbac220686485284ca809b50fc7c7f, State: Initialized, Role: FOLLOWER
I20260807 20:01:03.848959 6835 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.849901 7081 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:03.850301 7081 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:01:03.851207 6835 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:01:03.851294 6805 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 20:01:03.851482 6805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:01:03.853953 6805 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.855154 6805 leader_election.cc:288] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [CANDIDATE]: Term 1 election: Requested vote from peers a3ab24b8cd214c2caf138ecf8ca4bb93 (127.5.197.189:34631), debcdc15280a470486bdedf65a0c26da (127.5.197.188:43439)
I20260807 20:01:03.856491 7008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3dbac220686485284ca809b50fc7c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "debcdc15280a470486bdedf65a0c26da"
I20260807 20:01:03.856947 7008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:01:03.862260 7008 raft_consensus.cc:2454] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3dbac220686485284ca809b50fc7c7f in term 1.
I20260807 20:01:03.863004 6777 leader_election.cc:302] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3dbac220686485284ca809b50fc7c7f, debcdc15280a470486bdedf65a0c26da; no voters:
I20260807 20:01:03.863456 7081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:01:03.876003 7081 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [term 1 LEADER]: Becoming Leader. State: Replica: b3dbac220686485284ca809b50fc7c7f, State: Running, Role: LEADER
I20260807 20:01:03.876634 7081 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.885427 7090 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3dbac220686485284ca809b50fc7c7f. Latest consensus state: current_term: 1 leader_uuid: "b3dbac220686485284ca809b50fc7c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:03.885885 7090 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: This master's current role is: LEADER
I20260807 20:01:03.902287 7104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:01:03.911687 6938 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } attempt: 5
W20260807 20:01:03.916309 6780 tablet.cc:2369] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:01:03.919835 7104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:01:03.943128 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.907835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35696 (local address 127.5.197.190:45443)
0807 20:01:03.908024 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.908030 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.908134 (+ 104us) server_negotiation.cc:407] Connection header received
0807 20:01:03.908570 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.908577 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.908660 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.908736 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.919088 (+ 10352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.920251 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.923377 (+ 3126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.924204 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.924317 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.933075 (+ 8758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.933082 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.933086 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.933131 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.936821 (+ 3690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.937643 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.937649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.937652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.937829 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.939774 (+ 1945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.939790 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.939793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.940137 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.940390 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.942506 (+ 2116us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.942747 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 20:01:03 dist-test-slave-6bbx krb5kdc[6726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132863, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.197.189@KRBTEST.COM for kudu/127.5.197.188@KRBTEST.COM
W20260807 20:01:03.952029 6976 tablet.cc:2369] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:01:03.955163 6942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.912283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.197.188:43439 (local address 127.0.0.1:56606)
0807 20:01:03.912691 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 20:01:03.912719 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 20:01:03.912832 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:01:03.933379 (+ 20547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:01:03.933384 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:01:03.933881 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:01:03.934116 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.934131 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.936265 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.936271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.937656 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:01:03.937672 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.944308 (+ 6636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.944315 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:01:03.944524 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.945101 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:01:03.945126 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:01:03.948246 (+ 3120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:01:03.952192 (+ 3946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.952208 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.952212 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.952740 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.953315 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:01:03.953320 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:01:03.953324 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:01:03.953491 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:01:03.954175 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:01:03.954181 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:01:03.954362 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 20:01:03.954511 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 20:01:03.954794 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287}
I20260807 20:01:03.956295 7111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.912678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56606 (local address 127.5.197.188:43439)
0807 20:01:03.932927 (+ 20249us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.932933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.932956 (+ 23us) server_negotiation.cc:407] Connection header received
0807 20:01:03.933007 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.933012 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.933082 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.934289 (+ 1207us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.934552 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.936082 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.937862 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.938499 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.944274 (+ 5775us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.948443 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.948450 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.948455 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.948492 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.952012 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.952911 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.952917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.952920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.953097 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.953645 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.953650 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.953654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.954021 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.955542 (+ 1521us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.955693 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.955894 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20116,"thread_start_us":20487,"threads_started":1}
I20260807 20:01:03.948879 6753 master_runner.cc:186] Error getting master registration for 127.5.197.189:34631: OK, instance_id { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" instance_seqno: 1786132863190915 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:01:03.962323 6938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93: Bootstrap starting.
I20260807 20:01:03.962353 6753 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 20:01:03.965619 7059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.909076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46154 (local address 127.5.197.189:34631)
0807 20:01:03.909288 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.909295 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.929855 (+ 20560us) server_negotiation.cc:407] Connection header received
0807 20:01:03.930317 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.930323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.930408 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.930477 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.938342 (+ 7865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.939343 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.945440 (+ 6097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.946139 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.946251 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.956745 (+ 10494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.956751 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.956755 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.956790 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.960264 (+ 3474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.962276 (+ 2012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.962281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.962284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.962465 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.963048 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.963053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.963057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.963401 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.963614 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.965096 (+ 1482us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.965313 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 20:01:03.965695 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:03.910579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56594 (local address 127.5.197.188:43439)
0807 20:01:03.910771 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:03.910778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:03.930102 (+ 19324us) server_negotiation.cc:407] Connection header received
0807 20:01:03.930527 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:03.930534 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:03.930630 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:03.930724 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:03.936612 (+ 5888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.937820 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.940394 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:03.941070 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:03.941171 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:03.952304 (+ 11133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:01:03.952310 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:01:03.952315 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:01:03.952350 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:01:03.955749 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.961537 (+ 5788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.961543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.961546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.961687 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:01:03.963057 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:01:03.963063 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:01:03.963066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:01:03.963428 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:01:03.963702 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:03.964671 (+ 969us) server_negotiation.cc:299] Negotiation successful
0807 20:01:03.965096 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 20:01:03.966681 6938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93: Neither blocks nor log segments found. Creating new log.
I20260807 20:01:03.968058 6938 log.cc:824] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93: Log is configured to *not* fsync() on all Append() calls
I20260807 20:01:03.976884 6938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93: No bootstrap required, opened a new log
I20260807 20:01:03.987970 6938 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.988359 6938 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ab24b8cd214c2caf138ecf8ca4bb93, State: Initialized, Role: FOLLOWER
I20260807 20:01:03.988873 6938 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } }
I20260807 20:01:03.991173 7008 raft_consensus.cc:1261] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [term 1 FOLLOWER]: Refusing update from remote peer b3dbac220686485284ca809b50fc7c7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:01:03.994740 7090 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:01:03.999926 7118 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:04.000403 7118 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:01:04.001451 6938 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:01:04.001499 6901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3dbac220686485284ca809b50fc7c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93"
I20260807 20:01:04.002302 6901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:01:04.008636 6901 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3dbac220686485284ca809b50fc7c7f in term 1.
I20260807 20:01:04.012051 6901 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [term 1 FOLLOWER]: Refusing update from remote peer b3dbac220686485284ca809b50fc7c7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:01:04.012861 7090 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:01:04.018646 7061 sys_catalog.cc:455] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3dbac220686485284ca809b50fc7c7f. Latest consensus state: current_term: 1 leader_uuid: "b3dbac220686485284ca809b50fc7c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:04.018947 7061 sys_catalog.cc:458] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:01:04.021656 7114 mvcc.cc:205] Tried to move back new op lower bound from 7316000210829156352 to 7316000210444787712. Current Snapshot: MvccSnapshot[applied={T|T < 7316000210829156352}]
I20260807 20:01:04.023504 7061 sys_catalog.cc:455] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3dbac220686485284ca809b50fc7c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:04.023787 7061 sys_catalog.cc:458] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:01:04.032624 7090 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3dbac220686485284ca809b50fc7c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:04.032943 7090 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: This master's current role is: LEADER
I20260807 20:01:04.033054 7104 catalog_manager.cc:1347] Generated new cluster ID: 02fe4f28f3e14bdd80b31b97bdc6d5da
I20260807 20:01:04.033128 7104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:01:04.034734 7118 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3dbac220686485284ca809b50fc7c7f. Latest consensus state: current_term: 1 leader_uuid: "b3dbac220686485284ca809b50fc7c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:04.035080 7118 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:01:04.036242 7081 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3dbac220686485284ca809b50fc7c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:04.036542 7081 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f [sys.catalog]: This master's current role is: LEADER
I20260807 20:01:04.051236 7118 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3dbac220686485284ca809b50fc7c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3dbac220686485284ca809b50fc7c7f" member_type: VOTER last_known_addr { host: "127.5.197.190" port: 45443 } } peers { permanent_uuid: "a3ab24b8cd214c2caf138ecf8ca4bb93" member_type: VOTER last_known_addr { host: "127.5.197.189" port: 34631 } } peers { permanent_uuid: "debcdc15280a470486bdedf65a0c26da" member_type: VOTER last_known_addr { host: "127.5.197.188" port: 43439 } } }
I20260807 20:01:04.051486 7118 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:01:04.051941 7123 mvcc.cc:205] Tried to move back new op lower bound from 7316000210829156352 to 7316000210444787712. Current Snapshot: MvccSnapshot[applied={T|T < 7316000210829156352}]
I20260807 20:01:04.084699 7104 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:01:04.086704 7104 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:01:04.099006 7104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3dbac220686485284ca809b50fc7c7f: Generated new TSK 0
I20260807 20:01:04.099118 7144 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 20:01:04.100232 7104 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 20:01:04.198238 7058 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.186052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35698 (local address 127.5.197.190:45443)
0807 20:01:04.186291 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.186302 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.196245 (+ 9943us) server_negotiation.cc:407] Connection header received
0807 20:01:04.196549 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.196556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.196640 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.196723 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.197978 (+ 1255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35698: BlockingRecv error: recv got EOF from 127.0.0.1:35698 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
W20260807 20:01:04.201471 7111 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.186091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56620 (local address 127.5.197.188:43439)
0807 20:01:04.186455 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.186461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.198397 (+ 11936us) server_negotiation.cc:407] Connection header received
0807 20:01:04.199844 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.199849 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.199935 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.200012 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.201237 (+ 1225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56620: BlockingRecv error: recv got EOF from 127.0.0.1:56620 (error 108)
Metrics: {"server-negotiator.queue_time_us":237}
W20260807 20:01:04.201934 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.198940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46168 (local address 127.5.197.189:34631)
0807 20:01:04.199105 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.199111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.200328 (+ 1217us) server_negotiation.cc:407] Connection header received
0807 20:01:04.200573 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.200578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.200688 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.200764 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.201715 (+ 951us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46168: BlockingRecv error: recv got EOF from 127.0.0.1:46168 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 20:01:04.229625 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.223550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46184 (local address 127.5.197.189:34631)
0807 20:01:04.223782 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.223789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.228218 (+ 4429us) server_negotiation.cc:407] Connection header received
0807 20:01:04.228445 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.228449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.228560 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.228651 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.229408 (+ 757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46184: BlockingRecv error: recv got EOF from 127.0.0.1:46184 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 20:01:04.235422 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.233412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46188 (local address 127.5.197.189:34631)
0807 20:01:04.233603 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.233609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.234102 (+ 493us) server_negotiation.cc:407] Connection header received
0807 20:01:04.234310 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.234315 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.234384 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.234465 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.235168 (+ 703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46188: BlockingRecv error: recv got EOF from 127.0.0.1:46188 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 20:01:04.242118 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.240228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46198 (local address 127.5.197.189:34631)
0807 20:01:04.240394 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.240400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.240867 (+ 467us) server_negotiation.cc:407] Connection header received
0807 20:01:04.241041 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.241046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.241119 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.241207 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.241874 (+ 667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46198: BlockingRecv error: recv got EOF from 127.0.0.1:46198 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260807 20:01:04.251329 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.249085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46212 (local address 127.5.197.189:34631)
0807 20:01:04.249542 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.249548 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.250041 (+ 493us) server_negotiation.cc:407] Connection header received
0807 20:01:04.250233 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.250238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.250308 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.250390 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.251046 (+ 656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46212: BlockingRecv error: recv got EOF from 127.0.0.1:46212 (error 108)
Metrics: {"server-negotiator.queue_time_us":328}
W20260807 20:01:04.264240 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.262172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46224 (local address 127.5.197.189:34631)
0807 20:01:04.262363 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.262369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.262852 (+ 483us) server_negotiation.cc:407] Connection header received
0807 20:01:04.263095 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.263099 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.263185 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.263271 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.264070 (+ 799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46224: BlockingRecv error: recv got EOF from 127.0.0.1:46224 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 20:01:04.289661 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.287573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.5.197.189:34631)
0807 20:01:04.287805 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.287812 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.288308 (+ 496us) server_negotiation.cc:407] Connection header received
0807 20:01:04.288502 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.288506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.288579 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.288666 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.289416 (+ 750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46228: BlockingRecv error: recv got EOF from 127.0.0.1:46228 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 20:01:04.326982 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.324875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46232 (local address 127.5.197.189:34631)
0807 20:01:04.325091 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.325098 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.325601 (+ 503us) server_negotiation.cc:407] Connection header received
0807 20:01:04.325819 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.325824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.325901 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.325988 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.326728 (+ 740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46232: BlockingRecv error: recv got EOF from 127.0.0.1:46232 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 20:01:04.396560 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.394363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46238 (local address 127.5.197.189:34631)
0807 20:01:04.394606 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.394613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.395036 (+ 423us) server_negotiation.cc:407] Connection header received
0807 20:01:04.395275 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.395279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.395353 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.395441 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.396319 (+ 878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46238: BlockingRecv error: recv got EOF from 127.0.0.1:46238 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 20:01:04.530969 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.529250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.5.197.189:34631)
0807 20:01:04.529424 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.529429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.529765 (+ 336us) server_negotiation.cc:407] Connection header received
0807 20:01:04.529935 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.529939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.530027 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.530122 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.530795 (+ 673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46252: BlockingRecv error: recv got EOF from 127.0.0.1:46252 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 20:01:04.792205 7059 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:01:04.790522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46264 (local address 127.5.197.189:34631)
0807 20:01:04.790696 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:04.790700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:04.790967 (+ 267us) server_negotiation.cc:407] Connection header received
0807 20:01:04.791136 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:04.791140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:04.791214 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:04.791308 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:01:04.792005 (+ 697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46264: BlockingRecv error: recv got EOF from 127.0.0.1:46264 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 20:01:04.811084 7077 catalog_manager.cc:1259] Loaded cluster ID: 02fe4f28f3e14bdd80b31b97bdc6d5da
I20260807 20:01:04.811187 7077 catalog_manager.cc:1552] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: loading cluster ID for follower catalog manager: success
I20260807 20:01:04.813699 7077 catalog_manager.cc:1574] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: acquiring CA information for follower catalog manager: success
I20260807 20:01:04.815423 7077 catalog_manager.cc:1602] T 00000000000000000000000000000000 P debcdc15280a470486bdedf65a0c26da: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:01:05.103659 7144 catalog_manager.cc:1259] Loaded cluster ID: 02fe4f28f3e14bdd80b31b97bdc6d5da
I20260807 20:01:05.103821 7144 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93: loading cluster ID for follower catalog manager: success
I20260807 20:01:05.106381 7144 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93: acquiring CA information for follower catalog manager: success
I20260807 20:01:05.108206 7144 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a3ab24b8cd214c2caf138ecf8ca4bb93: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:01:05.314661 7234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:05.307883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46266 (local address 127.5.197.189:34631)
0807 20:01:05.308682 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:05.308687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:05.308704 (+ 17us) server_negotiation.cc:407] Connection header received
0807 20:01:05.308766 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:05.308770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:05.308941 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:05.309050 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:05.309515 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.310368 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.312301 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.312729 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.312820 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:05.313438 (+ 618us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:05.314008 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:05.314117 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:05.314254 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 20:01:05.314323 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":542,"threads_started":1}
I20260807 20:01:05.326946 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:05.320875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56634 (local address 127.5.197.188:43439)
0807 20:01:05.321460 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:05.321464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:05.321483 (+ 19us) server_negotiation.cc:407] Connection header received
0807 20:01:05.321571 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:05.321574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:05.321714 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:05.321843 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:05.322318 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.323017 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.324871 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.325268 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.325368 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:05.325885 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:05.326378 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:05.326482 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:05.326600 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 20:01:05.326666 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":377,"threads_started":1}
I20260807 20:01:05.357928 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:05.333408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56638 (local address 127.5.197.188:43439)
0807 20:01:05.333566 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:05.333573 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:05.350828 (+ 17255us) server_negotiation.cc:407] Connection header received
0807 20:01:05.351176 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:05.351182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:05.351279 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:05.351370 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:05.352288 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.353440 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.355705 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.356329 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.356434 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:05.357083 (+ 649us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:05.357229 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:05.357287 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:05.357515 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 20:01:05.357606 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:01:05.358286 7252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:05.333191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35700 (local address 127.5.197.190:45443)
0807 20:01:05.349441 (+ 16250us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:05.349447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:05.349468 (+ 21us) server_negotiation.cc:407] Connection header received
0807 20:01:05.349603 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:05.349609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:05.349834 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:05.350030 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:05.350766 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.351907 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.354105 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.354717 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.354842 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:05.355599 (+ 757us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:05.356115 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:05.356227 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:05.357910 (+ 1683us) server_negotiation.cc:299] Negotiation successful
0807 20:01:05.357996 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16088,"thread_start_us":16963,"threads_started":1}
I20260807 20:01:05.363294 7234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:01:05.351012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46268 (local address 127.5.197.189:34631)
0807 20:01:05.351225 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 20:01:05.351231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:01:05.356812 (+ 5581us) server_negotiation.cc:407] Connection header received
0807 20:01:05.357104 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:01:05.357110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:01:05.357210 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:01:05.357277 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:01:05.358521 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.359571 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.361398 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:01:05.361936 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:01:05.362059 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:01:05.362547 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:01:05.362665 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:01:05.362760 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 20:01:05.362890 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 20:01:05.362988 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 20:01:05.364101 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6753
I20260807 20:01:05.365144 6828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:01:05.476430 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6753
I20260807 20:01:05.501713 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6847
I20260807 20:01:05.502863 6932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:01:05.610709 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6847
I20260807 20:01:05.638947 5910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu pid 6947
I20260807 20:01:05.640061 7039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 20:01:05.745724 5910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskQ2gOvL/build/asan/bin/kudu with pid 6947
2026-08-07T20:01:05Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5083 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10139 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (374304 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST